-- Logs begin at Fri 2021-04-30 12:29:35 UTC, end at Fri 2021-04-30 13:33:13 UTC. -- Apr 30 13:02:39.718865 dv-cinder-784453-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 13:02:39.727864 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 13:02:39 2021] *** Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: nodename: dv-cinder-784453-4-iscsi Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: machine: x86_64 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: clock source: unix Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: pcre jit disabled Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: detected number of CPU cores: 4 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: current working directory: / Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: detected binary path: /usr/bin/uwsgi-core Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: your processes number limit is 47680 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: your memory page size is 4096 bytes Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: detected max file descriptor number: 2048 Apr 30 13:02:39.730179 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: lock engine: pthread robust mutexes Apr 30 13:02:39.731202 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: thunder lock: enabled Apr 30 13:02:39.731202 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 13:02:39.731202 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 13:02:39.770066 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: Python main interpreter initialized at 0x561e4eb429c0 Apr 30 13:02:39.770066 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: python threads support enabled Apr 30 13:02:39.770066 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: your server socket listen backlog is limited to 100 connections Apr 30 13:02:39.770066 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: your mercy for graceful operations on workers is 90 seconds Apr 30 13:02:39.770468 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 13:02:39.770468 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: *** Operational MODE: preforking *** Apr 30 13:02:39.770696 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: *** uWSGI is running in multiple interpreter mode *** Apr 30 13:02:39.770696 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: spawned uWSGI master process (pid: 73132) Apr 30 13:02:39.770959 dv-cinder-784453-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 13:02:39.773787 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: spawned uWSGI worker 1 (pid: 73133, cores: 1) Apr 30 13:02:39.773787 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: spawned uWSGI worker 2 (pid: 73134, cores: 1) Apr 30 13:02:39.773787 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 13:02:41.364275 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:02:41.364275 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: from cryptography.utils import int_from_bytes Apr 30 13:02:41.365107 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:02:41.365107 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: from cryptography.utils import int_from_bytes Apr 30 13:02:41.365747 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:02:41.365747 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: from cryptography.utils import int_from_bytes Apr 30 13:02:41.366277 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:02:41.366277 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: from cryptography.utils import int_from_bytes Apr 30 13:02:43.884490 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:02:43.885302 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:02:43.885423 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:02:43.885423 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:02:43.885851 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:02:43.885851 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:02:43.885985 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:02:43.886054 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:02:43.886124 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:02:43.886194 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.886270 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:02:43.886517 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.886621 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.886873 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887011 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887196 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887342 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887534 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887673 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887843 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.887986 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.888172 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.888335 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.888504 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.888699 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.888862 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889124 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889291 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889487 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889641 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889788 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.889942 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.890102 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784453-4-iscsi {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.890332 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784453-4-iscsi {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.890495 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.890723 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.890907 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891068 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891221 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891369 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891603 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891716 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.891918 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.892027 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.892273 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.892363 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.892784 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.892899 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894040 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894166 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894166 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894315 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894435 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894560 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894689 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894862 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.894981 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895109 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895247 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895372 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895552 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895689 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895816 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.895944 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896062 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896178 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896314 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896448 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896579 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784453-4-iscsi {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896718 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896867 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.896999 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897128 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897367 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784453-4-iscsi {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897515 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897753 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897873 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.897961 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.898092 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.898281 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.898394 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.898710 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.898815 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899020 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899107 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899338 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899435 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899661 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899760 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.899982 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900073 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900292 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900400 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900657 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900924 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.900924 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.901327 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.901581 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.901792 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.902027 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.902240 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.902458 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.902678 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.902904 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.903124 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.903336 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.903562 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.903781 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904003 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904244 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904449 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904645 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904891 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.904891 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.905280 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.905512 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.905660 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.905660 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.905933 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906062 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906188 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906330 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906484 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906644 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906767 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906767 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.906994 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907127 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907273 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907405 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907547 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907684 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907814 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.907942 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908088 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908241 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908401 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908541 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908689 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908838 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.908993 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909140 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909278 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909441 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909600 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909759 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.909914 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910065 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910206 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910343 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910481 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910643 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910794 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.910941 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911081 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911221 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911369 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911523 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911670 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911818 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.911964 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912116 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912256 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912412 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912561 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912713 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912852 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.912990 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913129 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913278 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913448 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913589 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913728 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.913879 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914036 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914176 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914329 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914483 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914629 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914779 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.914936 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915075 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915276 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915417 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915565 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915712 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.915874 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916068 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916201 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916341 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916479 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916628 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916790 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.916939 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917088 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917229 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917367 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917621 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917771 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.917918 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918059 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918206 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918345 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918500 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918654 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918803 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.918951 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919147 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919287 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919438 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919587 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919794 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.919946 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920094 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920233 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920389 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920546 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920699 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920840 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.920981 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921130 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921285 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921446 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921587 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921747 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.921910 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922059 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922214 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922354 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922500 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922652 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922801 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.922942 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923100 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923248 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923389 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923549 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923698 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.923852 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924010 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924149 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924286 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924425 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924563 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924702 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.924857 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925006 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925212 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925459 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925602 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925761 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.925901 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926039 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926178 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926328 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926480 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926740 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.926899 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927039 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927189 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927337 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927472 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927619 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927767 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.927918 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928065 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928213 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928353 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928504 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928642 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928780 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.928918 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929056 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929202 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929358 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929536 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929685 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929833 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.929973 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.930124 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.930272 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.930425 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.930562 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.930687 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.930824 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.930966 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:02:43.931091 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931213 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931337 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931474 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931599 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931736 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931869 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.931993 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932124 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932247 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932381 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932504 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932627 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932749 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932872 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.932997 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933138 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933262 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933467 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933614 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933758 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.933897 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934048 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934199 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934342 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934483 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934483 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934752 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.934916 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935101 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935101 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935505 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935650 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935802 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.935964 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936107 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936310 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936456 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936456 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936736 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.936943 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.937142 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.937142 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.937796 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.937796 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938070 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938237 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938391 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938532 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938685 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938826 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.938986 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939128 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939329 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939475 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939620 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939772 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.939928 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940070 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940219 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940362 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940503 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940644 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940797 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.940933 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941063 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941199 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941342 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941571 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941729 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.941871 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942003 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942143 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942293 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942447 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942611 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942756 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.942899 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943040 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943183 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943346 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943504 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943649 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943808 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.943950 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944100 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944256 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944397 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944538 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944679 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944820 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.944962 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945116 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945270 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945490 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945653 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945798 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.945949 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946112 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946255 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946397 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946546 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946701 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.946855 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947009 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947153 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947304 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947455 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947584 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947724 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947862 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.947988 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948135 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948261 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948396 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948631 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948769 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.948908 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949034 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949188 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949341 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949341 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949671 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949806 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.949932 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950085 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950240 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950392 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950537 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950681 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.950838 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951014 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951171 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951314 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951467 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951609 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951751 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.951891 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952047 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952190 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952332 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952476 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952631 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952785 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.952946 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953090 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953233 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953397 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953561 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953714 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.953874 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954016 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954157 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954299 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954441 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954595 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954755 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.954898 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955049 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955190 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955341 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955559 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955713 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.955867 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956009 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956155 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956295 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956505 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956653 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956809 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.956962 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957104 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957256 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957450 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957596 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957738 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.957882 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958023 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958183 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958352 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958507 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958650 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958812 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.958954 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959109 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959246 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959375 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959573 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959717 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.959869 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960030 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960190 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960341 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960485 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960635 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960777 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.960931 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961075 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961218 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961425 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961575 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961735 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.961896 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962039 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962190 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962343 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962486 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962647 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962791 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.962935 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963076 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963228 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963369 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963533 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963676 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963830 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.963973 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964116 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964256 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964413 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964558 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964703 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964845 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.964987 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965128 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965284 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965450 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965645 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965808 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.965952 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966108 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966264 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966407 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966600 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966744 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.966881 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967032 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967177 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967330 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967471 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967609 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967808 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.967964 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968104 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968260 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968411 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968554 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968696 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968851 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.968995 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969137 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969279 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969527 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969674 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969837 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.969979 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970127 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970266 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970405 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970556 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970710 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970852 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.970994 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971139 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971312 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971477 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971618 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971758 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.971928 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972079 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972274 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972435 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972575 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972719 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.972888 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973034 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973211 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973407 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973558 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973698 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.973870 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974037 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974195 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974350 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974503 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974644 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974780 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.974916 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975104 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975250 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975420 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975578 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975782 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.975930 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976086 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976240 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976393 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976544 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976756 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.976901 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977157 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977303 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977518 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977663 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977805 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.977949 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978108 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978251 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978407 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978561 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978714 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.978856 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979010 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979154 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979294 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979445 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979687 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979848 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.979993 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980172 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980317 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980457 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980600 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980755 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.980897 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981050 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981194 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981345 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981561 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981734 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.981878 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982020 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982309 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982463 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982618 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982774 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.982917 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983060 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983203 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983358 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983514 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983662 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983805 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.983959 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984103 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984245 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984400 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984545 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984699 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.984858 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985010 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985162 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985318 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985599 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985747 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.985955 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986105 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986240 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986386 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986529 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986673 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.986875 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987033 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987174 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987335 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987481 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987625 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987766 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.987907 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988061 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988204 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988345 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988485 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988628 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988770 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.988930 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989074 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989216 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989351 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989531 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989667 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989823 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.989958 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990098 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990250 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990441 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990588 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990793 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.990942 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991083 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991221 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991404 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991561 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991702 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991842 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.991981 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992120 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992304 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992463 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992614 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992755 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.992896 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993046 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993185 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993344 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993547 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993704 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.993859 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994021 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994174 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994312 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994474 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994627 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994778 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.994919 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995058 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995208 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995349 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995501 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995629 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995753 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.995920 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996111 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996267 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996424 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996547 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996681 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996820 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.996945 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997128 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997289 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997501 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997648 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997820 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.997962 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998105 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998262 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998407 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998542 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998673 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998812 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.998965 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999127 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999268 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999411 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999593 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999739 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:43.999895 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000040 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000184 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000326 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000497 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000657 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.000908 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001056 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001199 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001342 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001582 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001727 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.001885 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002039 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002180 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002324 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002474 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002619 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002782 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.002925 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003068 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003210 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003351 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003506 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003648 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003790 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.003936 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004079 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004232 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004396 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004549 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004693 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004834 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.004976 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005118 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005278 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005429 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005558 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005700 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.005856 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006001 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006205 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006353 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006496 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006646 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006789 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.006931 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007087 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007239 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007375 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007518 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007670 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007828 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.007971 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008114 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008254 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008396 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008547 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008701 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008844 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.008985 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009160 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009307 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009547 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009711 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009854 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.009995 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010136 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010277 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010429 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010584 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010735 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.010877 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011057 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011206 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011391 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011555 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011697 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.011840 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012012 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012161 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012315 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012458 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012635 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012784 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.012958 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013094 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013281 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013514 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013690 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013851 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.013999 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014141 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014296 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014438 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014610 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014759 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.014932 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015081 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015239 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015384 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015537 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015680 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.015863 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016027 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016171 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016295 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016470 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016612 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016767 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.016925 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017064 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017188 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017452 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017603 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017748 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.017918 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018064 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018202 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018346 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018487 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018762 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.018923 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019080 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019223 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019377 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019522 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019662 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019817 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.019991 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020150 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020306 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020459 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020607 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020728 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.020941 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021091 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021238 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021410 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021687 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021849 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.021985 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022121 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022301 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022447 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022613 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022763 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.022923 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023059 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023235 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023380 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023550 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023689 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023825 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.023961 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024143 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024302 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024464 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024598 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024775 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.024916 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025100 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025248 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025472 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025624 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025776 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.025911 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026166 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026323 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026462 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026583 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026790 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.026952 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027192 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027351 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027522 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027679 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027821 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.027970 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028156 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028303 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028478 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028633 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028785 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.028927 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029167 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029301 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029466 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029666 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029811 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.029998 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030258 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030398 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030537 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030675 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030826 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.030964 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031121 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031271 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031412 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031551 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031704 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.031846 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032004 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032180 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032329 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032604 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032748 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.032915 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033051 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033233 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033458 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033588 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033721 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.033915 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034065 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034206 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034349 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034521 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034673 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034831 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.034991 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035133 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035270 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035411 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035564 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035723 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.035864 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036039 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036194 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036343 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036549 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036747 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.036887 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037038 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037187 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037328 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037626 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037771 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.037891 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038014 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038138 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038275 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038437 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038577 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038719 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.038859 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039013 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039154 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039316 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039456 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039593 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039729 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.039865 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040037 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040195 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040395 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040537 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040671 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040821 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.040973 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041114 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041254 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041422 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041580 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041729 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.041904 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042052 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042235 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042379 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042572 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042719 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.042904 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043048 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043196 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043333 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043551 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043696 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.043882 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.044022 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.044204 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.044357 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.044527 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.044759 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045062 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045216 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045216 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045541 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045682 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045817 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.045957 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046093 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046257 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046408 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046547 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046741 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.046885 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047039 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047179 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047332 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047473 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047678 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047822 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.047984 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048126 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048265 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048408 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048548 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048688 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048841 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.048980 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049118 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049266 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049475 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049616 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049774 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.049913 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050057 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050187 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050316 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050462 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050668 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050813 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.050964 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051107 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051250 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051406 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051551 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051691 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051833 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.051973 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052113 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052267 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052418 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052552 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052672 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.052881 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053025 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053205 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053351 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053560 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053702 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.053886 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054032 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054194 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054335 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054514 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054655 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054833 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.054990 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055131 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055270 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055454 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055601 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055772 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.055931 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.056097 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.056240 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.056427 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.056687 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057012 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057168 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057310 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057492 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057687 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057849 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.057995 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058150 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058319 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058465 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058653 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058809 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.058967 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059103 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059274 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059415 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059592 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059750 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.059905 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.060056 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.060398 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.060620 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.060823 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.060966 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061116 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061266 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061437 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061578 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061719 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.061880 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.062018 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.062156 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.062636 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.062778 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.062918 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063070 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063206 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063346 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063578 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063730 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.063884 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064027 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064209 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064356 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064537 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064682 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.064864 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065008 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065189 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065337 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065612 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065776 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.065931 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066127 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066287 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066430 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066580 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066733 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.066876 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067000 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067124 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067256 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067396 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067549 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067686 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.067880 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068040 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068196 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068371 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068531 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068681 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068822 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.068998 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.069142 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.069328 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.069509 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.069679 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.069939 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.070258 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.070401 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.070648 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.070780 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.070899 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071030 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071229 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071369 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071554 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071695 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.071878 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072009 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072207 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072366 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072518 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072650 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072812 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.072952 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073131 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073282 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073487 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073640 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073769 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.073886 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074076 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074236 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074405 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074536 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074720 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.074849 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.075035 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.075184 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.075349 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.075491 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.075675 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.076151 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.076336 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.076511 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.076696 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.076829 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077033 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077235 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077419 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077550 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077721 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.077854 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078052 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078190 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078350 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078496 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078690 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.078840 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079005 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079145 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079320 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079469 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079645 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079836 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.079982 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080113 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080259 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080405 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080540 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080685 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.080858 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081069 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081207 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081366 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081556 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081695 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.081849 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082003 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082143 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082312 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082527 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082669 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082810 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.082965 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083101 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083235 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083369 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083505 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083633 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083778 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.083914 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084063 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084198 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084337 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084507 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084674 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084815 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.084956 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085137 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085282 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085546 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085696 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085837 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.085977 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086129 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086271 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086427 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086569 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086710 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.086868 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087010 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087154 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087302 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087439 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087575 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087717 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.087868 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088009 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088207 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088364 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088506 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088648 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088840 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.088986 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.089141 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.089294 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.089564 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.089719 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.089859 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.090011 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.090153 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.090290 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.090490 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.090738 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.091081 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.091304 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.091448 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.091831 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.091831 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092069 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092202 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092355 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092494 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092643 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092782 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.092921 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093061 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093221 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093364 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093538 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093695 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.093837 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094000 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094143 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094281 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094420 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094588 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094745 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.094943 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.095145 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.095466 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.095616 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.095768 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.095922 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096078 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096219 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096361 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096505 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096687 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.096834 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097043 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097197 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097454 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097662 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097807 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.097964 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098104 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098240 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098433 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098580 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098720 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.098873 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099016 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099172 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099313 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099455 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099595 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099750 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.099881 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100011 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100185 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100328 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100505 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100769 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.100925 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101066 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101206 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101447 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101619 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101761 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.101900 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102038 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102189 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102329 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102482 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102626 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102824 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.102971 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.103172 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.103319 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.103506 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.103660 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.103844 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104002 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104150 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104300 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104439 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104579 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104752 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.104907 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105063 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105219 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105360 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105552 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105749 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.105897 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106050 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106203 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106387 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106545 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106725 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.106873 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107047 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107288 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107430 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107626 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107792 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.107932 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108079 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108232 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108374 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108514 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108670 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108823 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.108977 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109121 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109306 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109500 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109643 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109834 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.109990 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110131 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110273 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110413 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110587 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110734 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.110895 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111036 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111177 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111318 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111513 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111657 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.111858 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112015 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112156 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112296 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112437 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112598 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112742 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.112893 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113046 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113188 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113368 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113601 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113732 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.113897 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114024 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114152 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114337 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114489 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114662 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114807 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.114979 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115116 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115293 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115431 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115622 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115760 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.115926 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116060 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116245 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116392 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116555 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116692 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116873 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.116997 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.117188 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.117288 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.117529 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.117621 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.117880 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118139 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118294 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118430 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118557 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118743 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.118888 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119043 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119190 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119329 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119471 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119607 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119751 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.119903 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120074 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120215 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120356 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120519 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120654 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120797 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.120965 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.121122 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.121261 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.121523 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.121746 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.121888 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122027 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122175 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122305 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122431 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122566 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122734 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.122882 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123018 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123224 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123365 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123585 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123727 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.123907 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124045 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124257 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124397 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124592 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124733 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.124866 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:02:44.125001 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:02:44.125176 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:02:44.160016 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_db.sqlalchemy.engines [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.161143 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_db.sqlalchemy.engines [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.403823 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.context [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),444fc578-91ce-49dd-ac6d-4dd08107152f(cell1) {{(pid=73134) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:02:44.404412 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.context [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),444fc578-91ce-49dd-ac6d-4dd08107152f(cell1) {{(pid=73133) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:02:44.408827 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_concurrency.lockutils [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:02:44.409029 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:02:44.410642 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_concurrency.lockutils [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:02:44.410787 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:02:44.411411 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_concurrency.lockutils [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:02:44.411594 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:02:44.413437 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_concurrency.lockutils [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:02:44.413764 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:02:44.451544 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_db.sqlalchemy.engines [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.453455 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_db.sqlalchemy.engines [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.455423 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_db.sqlalchemy.engines [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.461041 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_db.sqlalchemy.engines [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.494753 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG oslo_db.sqlalchemy.engines [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.495651 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_db.sqlalchemy.engines [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:02:44.920253 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: WARNING keystonemiddleware.auth_token [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:02:44.924838 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: WARNING keystonemiddleware.auth_token [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:02:44.926995 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: WARNING keystonemiddleware.auth_token [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:02:44.931412 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: WARNING keystonemiddleware.auth_token [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:02:45.137866 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: WARNING keystonemiddleware.auth_token [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:02:45.143162 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: WARNING keystonemiddleware.auth_token [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:02:45.144139 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: WARNING keystonemiddleware.auth_token [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:02:45.148611 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e4eb429c0 pid: 73134 (default app) Apr 30 13:02:45.149414 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: WARNING keystonemiddleware.auth_token [None req-6009428c-123d-4d27-8c0b-b2e0e9ba2081 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:02:45.150770 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:02:45.151912 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Apr 30 13:02:45.152294 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 789 bytes} [Fri Apr 30 13:02:45 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:02:45.154900 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e4eb429c0 pid: 73133 (default app) Apr 30 13:04:06.950737 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:06.951823 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Apr 30 13:04:06.952285 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:07.530169 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-89e8e5e8-4333-4b20-b6fd-846029dd21b8 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:07.561753 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-89e8e5e8-4333-4b20-b6fd-846029dd21b8 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.601819 Apr 30 13:04:07.562837 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Apr 30 13:04:06 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:09.720230 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:09.721143 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-831a96a6-0697-4133-87ff-c22a5cd4bab6 None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 30 13:04:09.721615 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:04:09.792054 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-4f0a60c7-8952-4448-9433-453547081c66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:09.812018 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:04:09.812018 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:04:09.843018 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-4f0a60c7-8952-4448-9433-453547081c66 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115005 Apr 30 13:04:09.844429 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:09 2021] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:04:10.191317 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-9f3a2bed-80a3-48e4-8173-c32bebb13711 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:10.193987 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:04:10.193987 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: warnings.warn(msg) Apr 30 13:04:10.239118 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-9f3a2bed-80a3-48e4-8173-c32bebb13711 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.386158 Apr 30 13:04:10.239900 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Apr 30 13:04:09 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:04:12.393413 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-4f0a60c7-8952-4448-9433-453547081c66 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:12.394430 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-4f0a60c7-8952-4448-9433-453547081c66 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Apr 30 13:04:12.394857 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:04:12.516166 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-4b3879d8-d93a-49d1-a262-b767486c73cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:12.534081 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:04:12.534081 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: warnings.warn(msg) Apr 30 13:04:12.559398 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-4b3879d8-d93a-49d1-a262-b767486c73cb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157342 Apr 30 13:04:12.560578 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:12 2021] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:12.573607 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-173d8100-19a1-40f3-b295-d28076d59314 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:12.575156 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:04:12.575156 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:04:12.617798 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-173d8100-19a1-40f3-b295-d28076d59314 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048445 Apr 30 13:04:12.618401 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Apr 30 13:04:12 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:14.773553 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-4b3879d8-d93a-49d1-a262-b767486c73cb admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:14.774443 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-4b3879d8-d93a-49d1-a262-b767486c73cb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 30 13:04:14.775459 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:14.848929 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-48a56274-27a4-4ec0-882a-7d939b3bae18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:14.881444 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-48a56274-27a4-4ec0-882a-7d939b3bae18 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098727 Apr 30 13:04:14.883046 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:14 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:14.895109 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-fe6feb84-a8bd-4117-965f-53bb55ee3361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:14.933468 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-fe6feb84-a8bd-4117-965f-53bb55ee3361 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042059 Apr 30 13:04:14.934355 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Apr 30 13:04:14 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:17.119892 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-48a56274-27a4-4ec0-882a-7d939b3bae18 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:17.120897 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-48a56274-27a4-4ec0-882a-7d939b3bae18 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Apr 30 13:04:17.121396 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:17.182792 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-30332192-bcfc-4cf4-8bd5-9a8b81a37cdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:17.209085 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-30332192-bcfc-4cf4-8bd5-9a8b81a37cdb admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081441 Apr 30 13:04:17.209677 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:17.224282 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-e9724c1c-8f3e-432c-a790-80dacab444df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:17.261250 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-e9724c1c-8f3e-432c-a790-80dacab444df admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041643 Apr 30 13:04:17.261980 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Apr 30 13:04:17 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:19.518558 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-30332192-bcfc-4cf4-8bd5-9a8b81a37cdb admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:19.519578 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-30332192-bcfc-4cf4-8bd5-9a8b81a37cdb admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Apr 30 13:04:19.519995 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:19.581839 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:19.609820 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083205 Apr 30 13:04:19.612559 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:19.623118 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-8fbbde5e-2df9-4805-b7a6-0927a3f009df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:19.660766 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-8fbbde5e-2df9-4805-b7a6-0927a3f009df admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042276 Apr 30 13:04:19.661579 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Fri Apr 30 13:04:19 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:21.837003 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:21.838829 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Apr 30 13:04:21.839267 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:21.904924 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-e2ce1c41-f793-450b-8778-09be79b24bea admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:21.926677 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-e2ce1c41-f793-450b-8778-09be79b24bea admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080137 Apr 30 13:04:21.927308 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Apr 30 13:04:21 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:04:24.142928 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:24.143945 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-391818f4-8292-4f76-84e5-6d0c8dde70c9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Apr 30 13:04:24.144342 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:24.211912 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-173c23c2-72a4-4917-a1dd-54e4606e0c55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "ram": 512}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:24.239663 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-173c23c2-72a4-4917-a1dd-54e4606e0c55 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088959 Apr 30 13:04:24.240142 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:24 2021] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:24.252551 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-225637ad-01a3-4ca7-a93f-e5da458b3de8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:24.293246 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-225637ad-01a3-4ca7-a93f-e5da458b3de8 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044729 Apr 30 13:04:24.293899 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Apr 30 13:04:24 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:26.537803 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-173c23c2-72a4-4917-a1dd-54e4606e0c55 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:26.539469 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-173c23c2-72a4-4917-a1dd-54e4606e0c55 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Apr 30 13:04:26.539924 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:26.602750 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-c5ca128b-58f6-4250-8b8f-a4c3629468d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "ram": 2048, "id": "2", "vcpus": 1}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:26.637421 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-c5ca128b-58f6-4250-8b8f-a4c3629468d1 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.090758 Apr 30 13:04:26.638079 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:26 2021] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:26.650706 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-32cace0d-24fd-4429-9870-361091665575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:26.691065 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-32cace0d-24fd-4429-9870-361091665575 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044013 Apr 30 13:04:26.691663 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Apr 30 13:04:26 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:04:29.033212 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-c5ca128b-58f6-4250-8b8f-a4c3629468d1 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:29.034327 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-c5ca128b-58f6-4250-8b8f-a4c3629468d1 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 Apr 30 13:04:29.034849 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:29.099982 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-d4e1594e-b574-4077-b5a0-4dca268611c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:29.132117 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-d4e1594e-b574-4077-b5a0-4dca268611c2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.090759 Apr 30 13:04:29.132722 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:29 2021] POST /compute/v2.1/flavors => generated 406 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:04:29.145298 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0621e4a5-f85d-4f0e-b160-4cd1a4bdb808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:29.187873 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0621e4a5-f85d-4f0e-b160-4cd1a4bdb808 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046282 Apr 30 13:04:29.188834 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Apr 30 13:04:29 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:31.426125 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-d4e1594e-b574-4077-b5a0-4dca268611c2 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:31.427184 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-d4e1594e-b574-4077-b5a0-4dca268611c2 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Apr 30 13:04:31.427840 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:31.507105 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-6c4b3be5-a356-4179-932c-c8f850b779ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "id": "4"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:31.534128 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-6c4b3be5-a356-4179-932c-c8f850b779ef admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.099683 Apr 30 13:04:31.534836 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:31.547136 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ac22bce1-9465-4c77-9bbc-045e33ff3d32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:31.586427 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ac22bce1-9465-4c77-9bbc-045e33ff3d32 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043026 Apr 30 13:04:31.587031 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Apr 30 13:04:31 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:04:33.830894 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-6c4b3be5-a356-4179-932c-c8f850b779ef admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:04:33.832166 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-6c4b3be5-a356-4179-932c-c8f850b779ef admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Apr 30 13:04:33.832585 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:04:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:04:33.909176 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "disk": 160, "ram": 16384, "id": "5", "os-flavor-access:is_public": true}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:33.936630 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.097504 Apr 30 13:04:33.937318 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Fri Apr 30 13:04:33 2021] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:04:33.969237 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-d42f45b0-7eda-4185-8c0f-1d21813b3ef7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:04:34.090659 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-d42f45b0-7eda-4185-8c0f-1d21813b3ef7 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143335 Apr 30 13:04:34.097414 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Fri Apr 30 13:04:33 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:05:12.780459 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:12.781519 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 30 13:05:12.781963 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Fri Apr 30 13:05:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:12.842462 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-96f98419-082b-4279-922c-a7a27f8ee4a4 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:12.865763 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-96f98419-082b-4279-922c-a7a27f8ee4a4 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077619 Apr 30 13:05:12.866317 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Fri Apr 30 13:05:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:14.243810 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:14.244869 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-85b273af-f7f7-4ba3-af78-3ea012c00589 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 30 13:05:14.245256 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:14.432394 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-5039ea59-e002-4841-8797-24ec8778a805 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:14.445904 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.wsgi [None req-5039ea59-e002-4841-8797-24ec8778a805 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 13:05:14.446432 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-5039ea59-e002-4841-8797-24ec8778a805 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:14.447275 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-5039ea59-e002-4841-8797-24ec8778a805 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.068266 Apr 30 13:05:14.447844 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1191 bytes} [Fri Apr 30 13:05:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:14.457585 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-65317c65-449e-423f-aaaa-9cc2d6d0ebbd admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:14.477654 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-65317c65-449e-423f-aaaa-9cc2d6d0ebbd admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023714 Apr 30 13:05:14.478188 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:14.488451 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-e9dc8237-b064-40b6-99e6-3682b02b36ec admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:14.509027 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-e9dc8237-b064-40b6-99e6-3682b02b36ec admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024243 Apr 30 13:05:14.509664 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:14.519575 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-cab3d99f-2069-4e85-8387-f57728fb5860 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:14.532405 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.wsgi [None req-cab3d99f-2069-4e85-8387-f57728fb5860 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 13:05:14.532996 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-cab3d99f-2069-4e85-8387-f57728fb5860 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:14.533852 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-cab3d99f-2069-4e85-8387-f57728fb5860 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.018041 Apr 30 13:05:14.534383 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1191 bytes} [Fri Apr 30 13:05:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:15.846579 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-e9dc8237-b064-40b6-99e6-3682b02b36ec admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:15.847880 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-e9dc8237-b064-40b6-99e6-3682b02b36ec admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Apr 30 13:05:15.848296 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:16.035783 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-48f2dabf-2adf-43e4-aaa1-5033d5e53dd2 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:16.048861 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.wsgi [None req-48f2dabf-2adf-43e4-aaa1-5033d5e53dd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 13:05:16.049357 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-48f2dabf-2adf-43e4-aaa1-5033d5e53dd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:16.050221 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-48f2dabf-2adf-43e4-aaa1-5033d5e53dd2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.066838 Apr 30 13:05:16.050784 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1191 bytes} [Fri Apr 30 13:05:15 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:16.064270 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-512598e3-a8f3-416c-9da6-3b2c147b2a72 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:16.090726 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-512598e3-a8f3-416c-9da6-3b2c147b2a72 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.031657 Apr 30 13:05:16.091302 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:16.101661 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-5d55849b-ee33-44e3-91a7-e9caabdfdc2b admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:16.122190 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-5d55849b-ee33-44e3-91a7-e9caabdfdc2b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024246 Apr 30 13:05:16.122762 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:16.133535 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-47f43022-52fd-437d-9e28-837a9d4414ee admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:16.147595 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.wsgi [None req-47f43022-52fd-437d-9e28-837a9d4414ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 13:05:16.148192 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-47f43022-52fd-437d-9e28-837a9d4414ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:16.148984 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-47f43022-52fd-437d-9e28-837a9d4414ee admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.019295 Apr 30 13:05:16.149567 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1191 bytes} [Fri Apr 30 13:05:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:17.516736 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-5d55849b-ee33-44e3-91a7-e9caabdfdc2b admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:17.517776 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-5d55849b-ee33-44e3-91a7-e9caabdfdc2b admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Apr 30 13:05:17.518172 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:05:17.715639 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-1d241b17-f255-466f-a4b7-f3b178c6c502 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:17.730399 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.wsgi [None req-1d241b17-f255-466f-a4b7-f3b178c6c502 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 13:05:17.730992 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-1d241b17-f255-466f-a4b7-f3b178c6c502 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:17.731807 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-1d241b17-f255-466f-a4b7-f3b178c6c502 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.079722 Apr 30 13:05:17.732355 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:05:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:17.742190 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-fce45ca1-4762-4731-9035-e12876d6df5b admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:17.763457 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-fce45ca1-4762-4731-9035-e12876d6df5b admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024836 Apr 30 13:05:17.764037 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:17.774887 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:17.795473 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024234 Apr 30 13:05:17.796073 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1211 bytes} [Fri Apr 30 13:05:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:05:17.806036 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-fbcf50fc-b550-444a-9c34-c2edd5c5185e admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:17.819402 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.wsgi [None req-fbcf50fc-b550-444a-9c34-c2edd5c5185e admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 13:05:17.819993 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-fbcf50fc-b550-444a-9c34-c2edd5c5185e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:05:17.820817 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-fbcf50fc-b550-444a-9c34-c2edd5c5185e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018526 Apr 30 13:05:17.821391 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:05:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:05:19.132280 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:19.133324 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Apr 30 13:05:19.133762 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:19.326400 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-58dd24ec-7fbc-4890-8a10-d238400e252c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:05:19.353085 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-58dd24ec-7fbc-4890-8a10-d238400e252c admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.082959 Apr 30 13:05:19.353572 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1236 bytes} [Fri Apr 30 13:05:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:05:20.692910 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:20.693965 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 30 13:05:20.694381 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:20.886944 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-e9745ce1-f38b-439b-bd82-d5cfc705fe5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:05:20.915722 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-e9745ce1-f38b-439b-bd82-d5cfc705fe5a admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.084638 Apr 30 13:05:20.916312 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1236 bytes} [Fri Apr 30 13:05:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:05:22.288718 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:22.289795 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Apr 30 13:05:22.290217 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:22.519159 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-0ff66856-41c3-4329-85bb-dab500971046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:05:22.551194 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-0ff66856-41c3-4329-85bb-dab500971046 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.121808 Apr 30 13:05:22.551783 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1236 bytes} [Fri Apr 30 13:05:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:05:23.904913 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:23.905984 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Apr 30 13:05:23.906365 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:24.105739 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-f6a0a6c9-a1a3-4225-8ae2-7ffa804d9d27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:05:24.131452 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-f6a0a6c9-a1a3-4225-8ae2-7ffa804d9d27 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.089966 Apr 30 13:05:24.131993 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1236 bytes} [Fri Apr 30 13:05:24 2021] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:05:25.462495 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:25.464332 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002595 Apr 30 13:05:25.465093 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:05:25 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:05:25.660033 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-40f916f9-a560-41df-9b74-b2cf29ba3a41 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:05:25.686985 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-40f916f9-a560-41df-9b74-b2cf29ba3a41 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.085059 Apr 30 13:05:25.687553 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1203 bytes} [Fri Apr 30 13:05:25 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:06:14.091481 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:06:14.093303 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-0a266611-d585-41a1-94dd-b0542d2f7f79 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Apr 30 13:06:14.093878 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 31/63] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:06:14 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:06:14.325137 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:06:14.351190 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.084116 Apr 30 13:06:14.351767 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1203 bytes} [Fri Apr 30 13:06:14 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:07:41.000074 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-f1ee25c0-87b9-49d6-a6f9-462753a7f375 tempest-verify_tempest_config-166074975 tempest-verify_tempest_config-166074975-project] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:07:41.002281 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-f1ee25c0-87b9-49d6-a6f9-462753a7f375 tempest-verify_tempest_config-166074975 tempest-verify_tempest_config-166074975-project] 10.222.0.69 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.134703 Apr 30 13:07:41.002851 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1134 bytes} [Fri Apr 30 13:07:40 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:23.852043 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:23.853075 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 30 13:09:23.853502 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 34/66] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:09:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:24.126848 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:24.128059 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:24.128059 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:09:24.129657 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:24.130129 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:24.130922 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:24.131337 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:24.165073 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-24e8db6a-a19d-4cc2-b077-0e3c7da356d0 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.163613 Apr 30 13:09:24.165691 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:09:24 2021] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:25.512516 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:25.513578 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 30 13:09:25.513980 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 35/68] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:09:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:25.705413 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:25.706735 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:25.706735 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:09:25.708558 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:25.709123 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:25.709999 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:25.710410 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:25.733483 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-31fae0b5-892c-4e31-b302-a84d4fd6f3d1 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.081580 Apr 30 13:09:25.733987 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 34/69] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:09:25 2021] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:09:37.531395 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:37.532438 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Apr 30 13:09:37.532870 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 36/70] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:09:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:37.726057 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:37.727325 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:37.727325 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:09:37.728856 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:37.729317 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:37.730138 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:37.730559 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:37.759174 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-95e3f892-227f-4d89-a69f-d396c1787d9e admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.087430 Apr 30 13:09:37.759677 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 35/71] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:09:37 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:09:39.104511 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: DEBUG nova.api.openstack.wsgi [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] Calling method '>' {{(pid=73134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:39.105593 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: INFO nova.api.openstack.requestlog [None req-ffeb36fa-a279-4c11-bca0-870f89439e16 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Apr 30 13:09:39.106000 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: [pid: 73134|app: 0|req: 37/72] 10.222.0.69 () {56 vars in 1075 bytes} [Fri Apr 30 13:09:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:39.293225 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG nova.api.openstack.wsgi [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] Calling method '>' {{(pid=73133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:39.294472 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:39.294472 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: warnings.warn(msg) Apr 30 13:09:39.295997 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:39.296440 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:39.297201 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:09:39.297677 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: DEBUG oslo_concurrency.lockutils [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:09:39.323393 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: INFO nova.api.openstack.requestlog [None req-d7a03b77-5e16-4c57-9f8f-97aa14aa6947 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.082096 Apr 30 13:09:39.323928 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: [pid: 73133|app: 0|req: 36/73] 10.222.0.69 () {60 vars in 1194 bytes} [Fri Apr 30 13:09:39 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:39.595452 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: Fri Apr 30 13:10:39 2021 - graceful shutdown triggered... Apr 30 13:10:39.596184 dv-cinder-784453-4-iscsi devstack@n-api.service[73134]: Gracefully killing worker 2 (pid: 73134)... Apr 30 13:10:39.596566 dv-cinder-784453-4-iscsi devstack@n-api.service[73133]: Gracefully killing worker 1 (pid: 73133)... Apr 30 13:10:39.600148 dv-cinder-784453-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 30 13:10:40.596538 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: worker 1 buried after 1 seconds Apr 30 13:10:40.596538 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: worker 2 buried after 1 seconds Apr 30 13:10:40.596538 dv-cinder-784453-4-iscsi devstack@n-api.service[73132]: goodbye to uWSGI. Apr 30 13:10:40.598441 dv-cinder-784453-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 30 13:10:40.599233 dv-cinder-784453-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 30 13:10:40.603042 dv-cinder-784453-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 13:10:40.617958 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 13:10:40.621031 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 13:10:40 2021] *** Apr 30 13:10:40.621296 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 13:10:40.621552 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 13:10:40.621738 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: nodename: dv-cinder-784453-4-iscsi Apr 30 13:10:40.621919 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: machine: x86_64 Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: clock source: unix Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: pcre jit disabled Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: detected number of CPU cores: 4 Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: current working directory: / Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: detected binary path: /usr/bin/uwsgi-core Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: your processes number limit is 47680 Apr 30 13:10:40.622130 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: your memory page size is 4096 bytes Apr 30 13:10:40.623042 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: detected max file descriptor number: 2048 Apr 30 13:10:40.623042 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: lock engine: pthread robust mutexes Apr 30 13:10:40.623042 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: thunder lock: enabled Apr 30 13:10:40.623042 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 13:10:40.623042 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 13:10:40.683298 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: Python main interpreter initialized at 0x555a29c479c0 Apr 30 13:10:40.683298 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: python threads support enabled Apr 30 13:10:40.683298 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: your server socket listen backlog is limited to 100 connections Apr 30 13:10:40.683298 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: your mercy for graceful operations on workers is 90 seconds Apr 30 13:10:40.684392 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 13:10:40.684392 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: *** Operational MODE: preforking *** Apr 30 13:10:40.684392 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: *** uWSGI is running in multiple interpreter mode *** Apr 30 13:10:40.684392 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: spawned uWSGI master process (pid: 87961) Apr 30 13:10:40.684656 dv-cinder-784453-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 13:10:40.685593 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: spawned uWSGI worker 1 (pid: 87983, cores: 1) Apr 30 13:10:40.686367 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: spawned uWSGI worker 2 (pid: 87984, cores: 1) Apr 30 13:10:40.686793 dv-cinder-784453-4-iscsi devstack@n-api.service[87961]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 13:10:43.047275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:10:43.047275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: from cryptography.utils import int_from_bytes Apr 30 13:10:43.048057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:10:43.048057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: from cryptography.utils import int_from_bytes Apr 30 13:10:43.218801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:10:43.218801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: from cryptography.utils import int_from_bytes Apr 30 13:10:43.219825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:10:43.219825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: from cryptography.utils import int_from_bytes Apr 30 13:10:45.938791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:10:45.939557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:10:45.939663 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:10:45.940154 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:10:45.940450 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:10:45.940893 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.941230 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.941627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.941962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.942301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.942694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.943101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.943428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.943766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.944153 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.944475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.944862 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784453-4-iscsi {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.945131 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.945522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.945791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.946124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.946917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.947263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.947612 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.948220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.950414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.950998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.951646 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.952280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.952941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.953487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.954061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.954805 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.955358 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.956214 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.956863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784453-4-iscsi {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.957501 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.958069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.958708 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.959956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.960559 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.961167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.961885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.962476 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.963075 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.963609 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.964163 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.964783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.965289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.965883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.966442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.966831 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.967307 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.967682 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.968096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.968513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.968940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.969663 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.970053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.970603 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.970953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.971390 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.971851 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.972265 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.972730 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.973119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.973524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.973998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.974349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:10:45.974848 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.974936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:10:45.975121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.975214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:10:45.975521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:10:45.975665 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.975746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:10:45.975918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.976119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.976298 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.976454 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.976776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.976958 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.977255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.977506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.977715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.977945 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.978117 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.978309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.978462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.978747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979043 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979485 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979648 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.979951 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.980090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784453-4-iscsi {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.980532 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.980700 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.980860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981703 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.981879 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982033 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.982948 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.983096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.983351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.983735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.983902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.984900 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.985215 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.985523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.985685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.985897 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.986141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.986297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784453-4-iscsi {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.986514 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.986694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.986886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.987150 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.987294 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.987497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.987650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.987876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.988191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.988353 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.988500 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.988834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.988998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.989299 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.989598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.989833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.990158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.990158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.990956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.991152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.991308 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.991456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.991456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.991884 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992330 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992851 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.992990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.993136 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.993341 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.993571 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.993739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.994160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.994312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.994312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.994600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.994875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995740 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.995896 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.996180 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.996404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.996554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.996791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.996942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.997168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.997611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.997843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.998070 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.998311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.998547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.998771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.998771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.999212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.999597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:45.999836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.000316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.001279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.001815 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.002144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.002397 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.002629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.002870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.002870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.003458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.003844 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.003844 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.004522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.004771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.005023 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.005251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.005560 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.005788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.005788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.006218 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.006468 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.006703 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.006938 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.007238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.007469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.007469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.008206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.008443 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.008670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.008892 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.009050 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.009290 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.009547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.009802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.009802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.010116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.010386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.010601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.010832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.010832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.011877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.012110 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.012357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.012598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.012598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.013215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.013499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.013727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.013954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.014225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.014686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.014686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.015136 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.015362 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.015591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.015837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.015837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.016269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.016459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.016615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.016769 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.016913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.017121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.017121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.017421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.017672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.017920 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.018352 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.018526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.018704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.018704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.019124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.019274 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.019423 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.019572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.019806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.020201 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.020389 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.020667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.020816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.020967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.021118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.021311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.021311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.022101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.022246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.022473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.022633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.022796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.023017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.023379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.023886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.023886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.024823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.025057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.025215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.025425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.025425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.025832 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.025984 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.026137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.026325 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.026468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.026645 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.026797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.026960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.026960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.027340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.027500 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.027652 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.027825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:10:46.028021 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.028232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.028551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.028719 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.028902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029276 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029485 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029703 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.029872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.030309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.030533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.030845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.031008 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.031240 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.031395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.031635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.032367 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.032523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.032672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.032879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.033055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.033055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.033495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.033659 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.033844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034378 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034522 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.034998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.035338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.035641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.035641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.035979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.036159 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.036411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.036607 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.036774 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.036939 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.037206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.037494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.037810 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.037968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.038110 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.038272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.038272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.038784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.038942 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.039093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.039292 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.039567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.039763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.039916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.040087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.040087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.040539 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.040746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041073 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.041938 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.042490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.042655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.042810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.042978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.043836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.044906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.045561 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.045806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.046024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.046024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.046470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.046470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.046895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047112 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.047911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048555 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.048995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.049317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.049317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.049673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.049872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.050051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.050210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.050425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.050749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.051045 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.051322 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.051472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.051668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.051849 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.052067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.052262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.052843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.052843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.053173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.053367 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.053632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.053946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.054181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.054410 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.054633 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.055229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.055491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.055768 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.056000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.056198 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.056451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.056606 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.056830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.057065 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.057304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.057784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.058034 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.058294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.058530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.058773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.058773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.059416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.059676 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.059925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.060163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.060396 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.060642 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.060642 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.061317 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.061746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.061746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.062183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.062427 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.063251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.063494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.063724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.063930 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.064210 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.064434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.064434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.064834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.065041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.065248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.065512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.065848 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.066050 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.066275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.066482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.066713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.066920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.067116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.067321 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.067625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.067849 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.068098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.068334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.068334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.068796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.069044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.069318 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.069830 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.070071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.070296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.070296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.070871 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.071271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.071627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.071946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.072139 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.072349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.072507 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.072681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.073183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.073568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.073842 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.074097 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.074337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.074587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.074816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.075042 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.075296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.075530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.075742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.076141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.076373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.076618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.076618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.077099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.077331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.077723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.077979 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.078231 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.078482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.078735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.078987 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.079223 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.079465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.079651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.080087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.080087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.080484 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.080654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.080881 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.081106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.081575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.081822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.081822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.082374 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.082565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.082774 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.082988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.082988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.083827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.084024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.084024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.084421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.084782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.085016 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.085265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.085558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.085931 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.086331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.086542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.086761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.087193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.087193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.087773 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.088129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.088377 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.088703 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.088703 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.089187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.089479 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.089791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.090210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.090466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.090708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.090708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.091367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.091778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.092035 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.092456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.092456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.092953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.093225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.093225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.094247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.094742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.094993 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.095240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.095240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.095751 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.095995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.095995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.096618 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.096864 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.097126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.097431 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.097431 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.097923 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.098167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.098167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.098667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.098923 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.098923 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.099404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.099657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.099657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.100181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.100963 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.101216 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.101527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.101527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.102113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.102383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.102383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.103101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.103362 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.103362 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.104188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.104595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.104595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.105064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.105319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.105661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.105894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.106125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.106344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.106344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.106946 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.107332 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.107332 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.107332 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.107955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.108185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.108185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.108620 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.108837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.108837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.109244 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.109505 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.109505 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.109944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.110155 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.110155 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.110710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.111104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.111330 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.111570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.111570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.111960 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.112184 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.112184 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.112615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.113003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.113246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.113520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.113520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.113962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.114527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.114527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.115103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.115315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.115543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.115758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.115758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.116229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.116440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.116675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.116894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.116894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.117627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.117860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.118100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.118354 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.118354 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.118778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.118995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.119210 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.119422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.119648 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.119891 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.119891 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.120300 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.120526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.120526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.121145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.121595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.121816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.122047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.122264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.122482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.122482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.122482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.123274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.123487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.123718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.123951 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.123951 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.124692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.125595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.126815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.127055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.127302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.127661 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.127888 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.128103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.128328 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.128666 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.128666 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.129084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.129303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.129303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.129783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.130023 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.130262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.130489 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.130719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.131091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.131325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.131572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.131572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.131856 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132169 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.132819 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.133197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.133197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.133969 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.134133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.134294 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.134445 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.134617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.135898 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.136059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.136329 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.136481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.136663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.136663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.137206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.137823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138691 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.138999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.139292 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.139455 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.139608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.139772 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.139935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.140871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.141055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.141231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.141231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.141231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.141875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142454 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.142583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.143104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.143268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.143268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.143268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144701 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.144894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.145695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.145847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.146763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.147649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.148409 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.148557 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.148719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.148865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149162 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149162 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.149940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150383 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.150983 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.151837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.152256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.152416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.152416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.152416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.152913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.153060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.153060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.153340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.154910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.155718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.155874 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.155874 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.155874 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.156305 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.156484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.156484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.156484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.156866 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.157747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.158056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.158515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.158515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.158515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.158515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159770 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159922 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.159922 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.160209 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.160502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.160502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.160502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.160955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.161966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162242 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162242 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.162702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163092 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.163783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.164599 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.164737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.164737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.164978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.165298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.165298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.165298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.165298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166556 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.166916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.167977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.168248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.168429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.168429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.168429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.168429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169829 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.169910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.170619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171644 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.171733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.172999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173564 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.173943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174813 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.174909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.175780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176586 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.176978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.177978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.178072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.178072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.178072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.178072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.178072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.179535 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180358 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.180537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.181944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.182709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.183407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.184103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.184267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.184267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.184435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.184561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.185658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186531 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.186628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187517 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187517 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.187962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.188640 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189500 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189707 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.189949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.190222 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.190509 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.190771 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.190893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.191138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.191404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.191532 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.191763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.192064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.192221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.192373 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.192693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.192859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.193051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.193410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.193533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.193729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194019 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194187 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194380 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194669 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.194983 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.195570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.195697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.195697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.195953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.196114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.196302 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.196668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.196783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.196872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.197299 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.197464 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.197684 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.197926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.198020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.198319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.198695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.198865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.199184 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.199295 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.199580 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.199842 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.199943 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.200417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.200525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.200646 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.200893 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.201027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.201256 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.201354 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.201682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.201808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.202017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.202364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.202472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.202694 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203159 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203759 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.203999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.204127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.204319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.204531 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.204696 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.204940 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.205105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.205274 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.205460 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.205635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.205923 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.206088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.206245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.206486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.206609 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.206875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207012 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207769 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.207863 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.208086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.208372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.208473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.208796 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.209004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.209238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.209576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.209744 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.209903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.210210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.210325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.210527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.210858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.210961 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.211182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.211332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.211508 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.211823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.212148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.212366 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.212689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.212785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.213013 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.213326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.213579 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.213724 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.213973 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.214066 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.214291 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.214569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.214713 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.214959 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.215181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.215303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.215592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.215787 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.216028 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.216312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.216430 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.216644 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.216972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.217088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.217315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.217563 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.217698 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.217976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.218092 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.218331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.218571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.218679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.218989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.219126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.219256 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.219412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.219563 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.219813 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.220960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.221234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.221337 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.221665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.221964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.222066 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.222226 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87983) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:10:46.222674 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.223238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.224919 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.225630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.226226 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.227814 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.227814 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.228351 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.228987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.229642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.230079 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.230558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.231122 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.231587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.231984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.232373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.232731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.233170 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.233652 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.234247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.234839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.235431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.236022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.236630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.237236 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.237877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.238508 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.239091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.239632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.240212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.240796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.241493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.242034 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.242679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.244589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.244912 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.245500 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.245879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.246270 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.246764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.247068 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.247420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.247801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.248107 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.248506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.248791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.249264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.249735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.250107 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.250470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.251088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.251617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.251787 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.252137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.252494 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.252864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.253215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.253706 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.253940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.254287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.254613 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.254968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.255334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.255685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.256045 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.256387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.256736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.257079 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.257503 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.257925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.258270 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.258591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.258994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.259332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.259667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.259992 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.260321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.260657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.260994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.261318 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.261686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.262036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.262382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.262752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.263142 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_db.sqlalchemy.engines [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.263286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.263489 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.263837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.264199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.265098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.265284 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.265608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.265969 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.266369 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.266685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.267147 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.267505 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.267891 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.268253 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.268601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.268950 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.269272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.269659 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.270015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.270360 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.270699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.271060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.271683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.272119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.272459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.272742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.273084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.273494 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.273826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.274144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.274696 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.275036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.275382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.275733 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.276064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.276405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.276767 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.277109 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.277481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.277826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.278173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.278515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.278883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.279206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.279519 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.279836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.280162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.280479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.280796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.281132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.281489 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.281830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.282513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.282513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.282818 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.283103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.283383 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.284248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.284248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.284826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.284826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.285765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.285765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.285765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.286642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.286642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.286642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.287204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.287375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.288039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.288408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.288741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.289119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.289534 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.289874 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.290285 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.290625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.290996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.291344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.291687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.292017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.292368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.292671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.293265 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.293651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.293992 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.294403 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.294724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.294979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.295375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.295668 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.296024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.296423 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.296746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.297352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.297352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.297699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.298453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.298453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.298677 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.299045 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.299420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.299764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.300119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.300471 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.300845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.301215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.301660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.302028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.302386 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.302743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.303134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.303468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.303752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.304228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.304601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.305338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.305883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.306238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.306694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.307022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.307427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.307824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.308256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.308649 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.308986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.309314 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.309767 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.310069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.310416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.310801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.311138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.311492 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.311836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.312206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.312578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.313175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.313355 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.313623 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.313960 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.314282 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.314642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.315001 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.315368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.315714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.316091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.316443 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.316796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.317140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.317543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.317902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.318263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.318670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.319047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.319409 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.319876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.320205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.320558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.320864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.321187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.321762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.322244 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.322768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.323204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.323553 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.323996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.324387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.324943 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.325553 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.326081 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.326429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.326956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.327334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.327785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.328140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:10:46.328394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:10:46.388282 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.636870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.context [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),444fc578-91ce-49dd-ac6d-4dd08107152f(cell1) {{(pid=87983) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:10:46.641773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:10:46.644107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:10:46.645140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:10:46.647503 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:10:46.692702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_db.sqlalchemy.engines [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.694672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_db.sqlalchemy.engines [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.753186 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_db.sqlalchemy.engines [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87983) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.788204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.context [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),444fc578-91ce-49dd-ac6d-4dd08107152f(cell1) {{(pid=87984) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:10:46.793251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:10:46.795039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:10:46.795956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:10:46.799157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:10:46.829840 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.846655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:46.880446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_db.sqlalchemy.engines [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:10:47.074797 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: WARNING keystonemiddleware.auth_token [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:10:47.081789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: WARNING keystonemiddleware.auth_token [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:10:47.200193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: WARNING keystonemiddleware.auth_token [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:10:47.207198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: WARNING keystonemiddleware.auth_token [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:10:47.337132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: WARNING keystonemiddleware.auth_token [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:10:47.342770 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: WARNING keystonemiddleware.auth_token [None req-0d39819c-586d-492c-a4b3-531b0d9fb813 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:10:47.349286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555a29c479c0 pid: 87983 (default app) Apr 30 13:10:47.439372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: WARNING keystonemiddleware.auth_token [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:10:47.450137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: WARNING keystonemiddleware.auth_token [None req-6c4a5711-a59b-4808-a052-f20fb55b223f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:10:47.460991 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555a29c479c0 pid: 87984 (default app) Apr 30 13:11:23.305866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-80b37e20-f7b2-4278-af42-d258b5decdbe tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Action: 'create', calling method: .version_select at 0x7fe2fcadfa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1465048563", "metadata": {"Type": "work"}}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:23.308846 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-80b37e20-f7b2-4278-af42-d258b5decdbe tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:23.310121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-80b37e20-f7b2-4278-af42-d258b5decdbe tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.292325 Apr 30 13:11:23.311389 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1156 bytes} [Fri Apr 30 13:11:22 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:11:23.326174 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e0cc172f-9a5a-42ce-b76d-528babef0df9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Action: 'create', calling method: .version_select at 0x7fe2fca2f940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-259444843", "metadata": {"Type": "work"}}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:23.330628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e0cc172f-9a5a-42ce-b76d-528babef0df9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:23.332420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e0cc172f-9a5a-42ce-b76d-528babef0df9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015314 Apr 30 13:11:23.334057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 2/2] 10.222.0.69 () {60 vars in 1156 bytes} [Fri Apr 30 13:11:23 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:11:23.346415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-960b5490-4081-480f-b122-f4894b8394c9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Action: 'create', calling method: .version_select at 0x7fe2fca2f9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-264736635", "metadata": {"Type": "work"}}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:23.348585 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-960b5490-4081-480f-b122-f4894b8394c9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:23.350215 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-960b5490-4081-480f-b122-f4894b8394c9 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010865 Apr 30 13:11:23.356491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 3/3] 10.222.0.69 () {60 vars in 1156 bytes} [Fri Apr 30 13:11:23 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:11:23.369813 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7b8f5c8f-7904-4fe8-88e5-fd5bc41502af tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Calling method '.version_select at 0x7fe2fc9c2430>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:23.650601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-954ecea5-a1af-4df4-98be-f7d6710cab06 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fca5faf0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:24.014238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-7b8f5c8f-7904-4fe8-88e5-fd5bc41502af tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] HTTP exception thrown: Volume tempest-invalid-1215087844 could not be found. Apr 30 13:11:24.014992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7b8f5c8f-7904-4fe8-88e5-fd5bc41502af tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 404 to user: Volume tempest-invalid-1215087844 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:24.016011 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7b8f5c8f-7904-4fe8-88e5-fd5bc41502af tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1215087844" status: 404 len: 99 microversion: 2.1 time: 0.653458 Apr 30 13:11:24.016719 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 4/4] 10.222.0.69 () {58 vars in 1218 bytes} [Fri Apr 30 13:11:23 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1215087844 => generated 99 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 13:11:24.026819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a1a78e7d-0b83-4b76-934a-8f5ba4fefc0b tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004461 Apr 30 13:11:24.027627 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 5/5] 10.222.0.69 () {58 vars in 1140 bytes} [Fri Apr 30 13:11:24 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 30 13:11:24.039518 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fb9262d6-54c9-4f79-bae9-2c3a9fe360a5 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004070 Apr 30 13:11:24.047654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 6/6] 10.222.0.69 () {58 vars in 1137 bytes} [Fri Apr 30 13:11:24 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 13:11:24.058587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-264d8acd-dbdc-4b0e-8cc0-92e1094e0a87 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Calling method '.version_select at 0x7fe2fd23e940>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:24.315302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-954ecea5-a1af-4df4-98be-f7d6710cab06 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/08da6fb4-4a7c-4977-b2db-54ed7a23cb10" status: 200 len: 350 microversion: 2.1 time: 1.431965 Apr 30 13:11:24.316598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 1/7] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:11:22 2021] GET /compute/v2.1/os-volumes/08da6fb4-4a7c-4977-b2db-54ed7a23cb10 => generated 350 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:24.376151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-264d8acd-dbdc-4b0e-8cc0-92e1094e0a87 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] HTTP exception thrown: Volume 41f55568-ed0f-4d57-99e1-b1db64c8f60f could not be found. Apr 30 13:11:24.376782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-264d8acd-dbdc-4b0e-8cc0-92e1094e0a87 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 404 to user: Volume 41f55568-ed0f-4d57-99e1-b1db64c8f60f could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:24.377852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-264d8acd-dbdc-4b0e-8cc0-92e1094e0a87 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/41f55568-ed0f-4d57-99e1-b1db64c8f60f" status: 404 len: 109 microversion: 2.1 time: 0.323342 Apr 30 13:11:24.378593 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 7/8] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:11:24 2021] DELETE /compute/v2.1/os-volumes/41f55568-ed0f-4d57-99e1-b1db64c8f60f => generated 109 bytes in 325 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:11:24.389601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4693113f-19aa-4405-a76d-659ca17af980 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Calling method '.version_select at 0x7fe2fc92a1f0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:24.648430 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-4693113f-19aa-4405-a76d-659ca17af980 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] HTTP exception thrown: Volume 632baa55-a5b9-49ca-822c-4b342bf958bd could not be found. Apr 30 13:11:24.649638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4693113f-19aa-4405-a76d-659ca17af980 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] Returning 404 to user: Volume 632baa55-a5b9-49ca-822c-4b342bf958bd could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:11:24.650537 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4693113f-19aa-4405-a76d-659ca17af980 tempest-VolumesNegativeTest-1861381536 tempest-VolumesNegativeTest-1861381536-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/632baa55-a5b9-49ca-822c-4b342bf958bd" status: 404 len: 109 microversion: 2.1 time: 0.265809 Apr 30 13:11:24.651540 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 2/9] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:11:24 2021] GET /compute/v2.1/os-volumes/632baa55-a5b9-49ca-822c-4b342bf958bd => generated 109 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:11:26.097554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dd45ea6c-891a-4c57-8bed-f8a2924f67a1 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc879430>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:26.218591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dd45ea6c-891a-4c57-8bed-f8a2924f67a1 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/bfb8337d-5093-4ded-8ad3-8ea9784a0d6a" status: 200 len: 351 microversion: 2.1 time: 0.124762 Apr 30 13:11:26.219404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 8/10] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:11:26 2021] GET /compute/v2.1/os-volumes/bfb8337d-5093-4ded-8ad3-8ea9784a0d6a => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:28.962978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194912412", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "cda1a518-add5-4bf9-aa6d-e957ae05d7db"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:29.258492 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] validate_networks() for [('cda1a518-add5-4bf9-aa6d-e957ae05d7db', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:11:30.538525 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5251b567-f74e-426b-8590-e5f8996ef954 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc8e8a60>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:30.763905 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5251b567-f74e-426b-8590-e5f8996ef954 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/01bf39e0-40df-4173-b153-4f7b9ccd41ba" status: 200 len: 351 microversion: 2.1 time: 0.228569 Apr 30 13:11:30.773533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 9/11] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:11:30 2021] GET /compute/v2.1/os-volumes/01bf39e0-40df-4173-b153-4f7b9ccd41ba => generated 351 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:11:30.780174 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-893b91b7-4af8-44f7-95a1-5bd2f481211e tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc8791f0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:31.020950 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-893b91b7-4af8-44f7-95a1-5bd2f481211e tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245532 Apr 30 13:11:31.022614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 10/12] 10.222.0.69 () {58 vars in 1134 bytes} [Fri Apr 30 13:11:30 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:31.039571 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-383a6a4d-1459-4c82-a41b-2af74d49fed9 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc8810d0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:31.250207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:11:31.250703 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:11:31.251095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:11:31.251501 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:11:31.251909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:11:31.280400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:31.282765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:31.283953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:31.284619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:31.285902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-383a6a4d-1459-4c82-a41b-2af74d49fed9 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.250407 Apr 30 13:11:31.286697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 11/13] 10.222.0.69 () {58 vars in 1149 bytes} [Fri Apr 30 13:11:31 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:31.301408 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-24abb74d-38a9-4a9d-b833-7767c9dd474e tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc8793a0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:31.376899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Getting quotas for project 4fa2f85932184fbeaadca042ca7ca85e. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:31.409568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Getting quotas for user d2715b60815d47b2a0e59f2bfa640a97 and project 4fa2f85932184fbeaadca042ca7ca85e. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:31.510428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:11:31.522985 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:11:31.637230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-24abb74d-38a9-4a9d-b833-7767c9dd474e tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.340870 Apr 30 13:11:31.639044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 12/14] 10.222.0.69 () {58 vars in 1134 bytes} [Fri Apr 30 13:11:31 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:31.651649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-86a47441-46a3-4abb-9a1b-05e55607ec6a tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc9c20d0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:31.800969 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-53215187-d257-436b-8bc8-fb278794c5d4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.523233 Apr 30 13:11:31.808966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 3/15] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:11:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 3526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:11:31.817445 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-57c61ba1-79ef-478f-9c7c-d93f53ef6df8 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:31.819496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-57c61ba1-79ef-478f-9c7c-d93f53ef6df8 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:31.865879 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-86a47441-46a3-4abb-9a1b-05e55607ec6a tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.218514 Apr 30 13:11:31.874739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 13/16] 10.222.0.69 () {58 vars in 1167 bytes} [Fri Apr 30 13:11:31 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:31.879881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5481f28d-afeb-4d4f-b1b8-60735b3880fd tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc881790>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:32.062372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-57c61ba1-79ef-478f-9c7c-d93f53ef6df8 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:32.089357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-57c61ba1-79ef-478f-9c7c-d93f53ef6df8 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1215 microversion: 2.1 time: 0.278928 Apr 30 13:11:32.094393 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 4/17] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:31 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:11:32.206727 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5481f28d-afeb-4d4f-b1b8-60735b3880fd tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.330594 Apr 30 13:11:32.207373 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 14/18] 10.222.0.69 () {58 vars in 1170 bytes} [Fri Apr 30 13:11:31 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:32.222113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e29dfa5d-00c9-4e22-8f4c-5c3484499684 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc7d41f0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:32.426064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e29dfa5d-00c9-4e22-8f4c-5c3484499684 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.209022 Apr 30 13:11:32.430948 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 5/19] 10.222.0.69 () {58 vars in 1155 bytes} [Fri Apr 30 13:11:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:32.448507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4ac7c8c5-9b0c-4357-959b-bfce05ea7f75 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc881430>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:32.715051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4ac7c8c5-9b0c-4357-959b-bfce05ea7f75 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.280010 Apr 30 13:11:32.716766 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 15/20] 10.222.0.69 () {58 vars in 1188 bytes} [Fri Apr 30 13:11:32 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:32.778575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-681a9762-8423-464f-b9fe-0b3c9d8d99f5 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] Calling method '.version_select at 0x7fe2fc7dd820>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:32.977825 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-681a9762-8423-464f-b9fe-0b3c9d8d99f5 tempest-VolumesTestJSON-2101456849 tempest-VolumesTestJSON-2101456849-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202490 Apr 30 13:11:32.992591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 6/21] 10.222.0.69 () {58 vars in 1155 bytes} [Fri Apr 30 13:11:32 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:11:33.118921 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-20a7e01a-f834-40af-acd7-4faeb65b506b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:33.119706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-20a7e01a-f834-40af-acd7-4faeb65b506b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:33.380921 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-20a7e01a-f834-40af-acd7-4faeb65b506b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:33.407704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-20a7e01a-f834-40af-acd7-4faeb65b506b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1215 microversion: 2.1 time: 0.294606 Apr 30 13:11:33.408650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 16/22] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:33 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:34.439595 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:34.442540 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:34.485138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:34.486088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:34.487983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:34.488853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:34.795257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:34.815549 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-677cf5e8-f3f6-4c26-a32d-a362af0e0579 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1219 microversion: 2.1 time: 0.383507 Apr 30 13:11:34.823459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 7/23] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:34 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1219 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:35.866230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:35.877942 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:35.899324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:35.900649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:35.904543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:35.905534 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:36.365123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:36.399234 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b1fb7465-ccad-459f-be3e-978c912e8968 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1267 microversion: 2.1 time: 0.555732 Apr 30 13:11:36.400690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 17/24] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:35 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1267 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:37.435756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:37.437845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:37.501839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:37.510229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:37.512127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:37.520748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:38.084534 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:38.159616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c2cd0a7d-f46a-477f-b09f-65bfb393c5dc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1273 microversion: 2.1 time: 0.732456 Apr 30 13:11:38.195313 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 8/25] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:37 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1273 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:39.197914 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:39.199436 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:39.219354 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:39.220116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:39.221173 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:39.221832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:39.867243 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:39.891469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-11bf3a64-9765-463c-ad6a-b10e747552f4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1273 microversion: 2.1 time: 0.697488 Apr 30 13:11:39.897291 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 18/26] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:39 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1273 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:40.924337 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:40.925111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:40.961133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:40.962095 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:40.966784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:40.972363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:41.327821 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: .version_select at 0x7fe2fc7d48b0>, body: {"keypair": {"name": "tempest-keypair-1170106625"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:41.470396 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:41.494274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:42.025274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:42.061236 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:42.152046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d0927bde-7704-473b-b9ae-fdc1fa6aa7f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.288025 Apr 30 13:11:42.182253 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 9/27] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Apr 30 13:11:40 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:42.211686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:42.245053 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e0c67285-de7f-4d34-8fb6-d9bb32286a27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1273 microversion: 2.1 time: 1.326042 Apr 30 13:11:42.255970 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 19/28] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:40 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1273 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:42.918224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-905806371", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac15dd92-c60f-42ab-a3ca-e4794ec69c58"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:43.133230 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] validate_networks() for [('ac15dd92-c60f-42ab-a3ca-e4794ec69c58', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:11:43.273784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:43.275139 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:43.289039 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:43.294263 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:43.295385 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:43.296005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:45.254146 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:45.268035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-417c8b77-eba9-4a1d-813b-27b0a98f0ffb tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.998106 Apr 30 13:11:45.274514 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 20/29] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:43 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:46.288770 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:46.289564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:46.313365 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:46.319585 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:46.322715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:46.323631 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:46.912000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:11:46.912498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:11:46.912899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:11:46.913307 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:11:46.913745 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:11:46.958867 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:46.961772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:46.962994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:46.964541 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:47.015857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Getting quotas for project 9ae82ace87d14c12b35259bd0973dda6. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:47.033096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Getting quotas for user ce34344206a94c50b0174dd726bf8e05 and project 9ae82ace87d14c12b35259bd0973dda6. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:47.097367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:11:47.114781 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:11:47.277515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e86cf709-22b0-47e0-bdf8-365c0346c27e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.086190 Apr 30 13:11:47.285513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 10/30] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:11:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 5102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:11:47.292605 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-86694430-a882-4c3b-b737-7648c40f7abb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:47.310049 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-86694430-a882-4c3b-b737-7648c40f7abb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:48.450491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-86694430-a882-4c3b-b737-7648c40f7abb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:48.465693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-86694430-a882-4c3b-b737-7648c40f7abb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1221 microversion: 2.1 time: 1.176882 Apr 30 13:11:48.473647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 11/31] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:47 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1221 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:48.691778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:48.704428 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-afd0a7ef-df20-40dd-bbc2-a6b8a09f10e9 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 2.419577 Apr 30 13:11:48.718968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 21/32] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:46 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 2435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:48.790135 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1117196086", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac15dd92-c60f-42ab-a3ca-e4794ec69c58"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:48.948612 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] validate_networks() for [('ac15dd92-c60f-42ab-a3ca-e4794ec69c58', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:11:49.727196 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:49.729893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:49.774448 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:49.774908 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:49.775720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:49.776163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:50.718247 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:50.731331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b69200fe-26ca-47f8-bf70-08b58efbd982 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.008105 Apr 30 13:11:50.741079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 22/33] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:49 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:51.753930 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:51.756096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:51.781326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:11:51.781945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:11:51.784300 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:11:51.785420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:11:51.786964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:11:51.822068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:51.822588 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:51.823510 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:51.831451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:51.836395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:51.838502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:51.848801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:51.849257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:51.977853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Getting quotas for project 9ae82ace87d14c12b35259bd0973dda6. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:51.999841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Getting quotas for user ce34344206a94c50b0174dd726bf8e05 and project 9ae82ace87d14c12b35259bd0973dda6. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:52.030356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:11:52.053484 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:11:52.205130 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5476cb60-02a5-43d8-83f2-ef8c0e46d30a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.420168 Apr 30 13:11:52.214289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 12/34] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:11:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 3430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:11:52.231061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-62bc8707-4a0a-4f05-bd04-d447f18510a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:52.236353 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-62bc8707-4a0a-4f05-bd04-d447f18510a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:52.782990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-62bc8707-4a0a-4f05-bd04-d447f18510a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:52.799187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-62bc8707-4a0a-4f05-bd04-d447f18510a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1222 microversion: 2.1 time: 0.577935 Apr 30 13:11:52.811945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 13/35] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:52 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1222 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:53.074381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:53.091558 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6ae92534-472c-4d8a-9051-1293832a784b tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.343716 Apr 30 13:11:53.092064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 23/36] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:51 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:53.826773 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:53.827440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:53.935344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:53.943726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:53.959538 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:53.960012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:54.109632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:54.110261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:54.147118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:54.155177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:54.165277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:54.171218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:54.791651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:54.807643 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d54e979d-5227-41c8-b96a-0960a3be00d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1226 microversion: 2.1 time: 0.984679 Apr 30 13:11:54.818006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 14/37] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:53 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1226 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:55.223872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:55.236346 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-33b6b73a-1bb8-43d1-aede-b53bb8180fca tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.131474 Apr 30 13:11:55.254088 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 24/38] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:54 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:11:55.827017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:55.827643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:55.871816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:55.872716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:55.873633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:55.874098 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:56.037043 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: .version_select at 0x7fe2fbfa7ee0>, body: {"keypair": {"name": "tempest-keypair-1607199296"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:56.068087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:56.073630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:56.793333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:11:56.809741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:11:56.858372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-75b375a1-18ec-419c-bc7b-44f9dce101b0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.528409 Apr 30 13:11:56.865768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 15/39] 10.222.0.69 () {62 vars in 1199 bytes} [Fri Apr 30 13:11:55 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1536 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:11:56.969022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-aefc477e-9d9f-41b7-b039-99cf98c47c48 req-60e6bab1-6504-4f81-90d0-f8bccff9f215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb724af6-2bbc-494b-a119-b61199e13df1", "tag": "e06c1645-fc5c-4d22-b639-0e71e1bddb8f"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:56.971610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:11:56.971610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:11:56.992178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-aefc477e-9d9f-41b7-b039-99cf98c47c48 req-60e6bab1-6504-4f81-90d0-f8bccff9f215 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:56.992747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-aefc477e-9d9f-41b7-b039-99cf98c47c48 req-60e6bab1-6504-4f81-90d0-f8bccff9f215 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:57.026672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-aefc477e-9d9f-41b7-b039-99cf98c47c48 req-60e6bab1-6504-4f81-90d0-f8bccff9f215 service nova] Creating event network-changed:e06c1645-fc5c-4d22-b639-0e71e1bddb8f for instance fb724af6-2bbc-494b-a119-b61199e13df1 on hv-cinder-78445 Apr 30 13:11:57.027462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-aefc477e-9d9f-41b7-b039-99cf98c47c48 req-60e6bab1-6504-4f81-90d0-f8bccff9f215 service nova] Acquired lock "compute-rpcapi-router" {{(pid=87984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 13:11:57.029090 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:57.029819 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:57.041911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:57.042599 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:57.064301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.compute.rpcapi [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 13:11:57.065293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] Releasing lock "compute-rpcapi-router" {{(pid=87984) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 13:11:57.124561 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5b1314af-5f3d-44a9-92f6-075b9134a689 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257270 Apr 30 13:11:57.125177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 16/40] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:57.130668 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:57.131650 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:57.140499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:57.141414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:57.142369 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:57.143217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:58.078018 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:58.114750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7a3eb148-3fb4-4b98-8dc6-8ea3e4b4ec40 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1274 microversion: 2.1 time: 2.291555 Apr 30 13:11:58.120791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 25/41] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:55 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1274 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:11:58.388512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:58.405789 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8a904f49-0892-4cf7-87e9-2dde995396aa tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.279027 Apr 30 13:11:58.407118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 17/42] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:57 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:59.136266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:59.137656 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:59.146700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:59.147609 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:59.149003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:59.149719 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:59.361079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:11:59.378648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-34a09a3c-14fa-4159-bf58-1ad61d123ff8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1280 microversion: 2.1 time: 0.239007 Apr 30 13:11:59.381345 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 26/43] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:59 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1280 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:11:59.424385 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:59.425196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:11:59.447116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:59.447892 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:11:59.451474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:11:59.458201 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:00.156499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:00.169810 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a35a59dc-6650-43a3-b959-8acd25acfc9e tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.749211 Apr 30 13:12:00.170620 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 18/44] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:11:59 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:00.396822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:00.398311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:00.411466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:00.413050 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:00.415218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:00.416318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:00.586268 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1747585320", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8d1fd53-0ee5-499f-9667-97dbc79cf1ea"}], "security_groups": [{"name": "tempest-securitygroup--1003191933"}], "key_name": "tempest-keypair-1170106625", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:00.839521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:00.848294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f5c7f44-e24c-42e8-8fce-88fe93ff5e0a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1280 microversion: 2.1 time: 0.455935 Apr 30 13:12:00.858766 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 27/45] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:00 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1280 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:01.176046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] validate_networks() for [('b8d1fd53-0ee5-499f-9667-97dbc79cf1ea', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:12:01.188211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:01.189103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:01.205477 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:01.208126 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:01.209342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:01.210032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:01.944085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:01.968358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a7bf2b7a-ec23-415d-a728-086db2c15d31 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.784217 Apr 30 13:12:01.970695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 28/46] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:01 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:01.983788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:01.985125 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:02.000369 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:02.001957 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:02.002966 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:02.003546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:02.607286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:12:02.607815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:12:02.608171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:12:02.608589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:12:02.609000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:12:02.623904 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:02.624312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:02.625136 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:02.625605 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:02.657495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:02.667076 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:12:02.672766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:12:02.684680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bc3a4d78-21ee-499c-9605-82578c3ad723 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.710068 Apr 30 13:12:02.689532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:12:02.692288 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:12:02.693547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 29/47] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:01 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:02.726645 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-254133624", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "384ed945-7697-4aed-a91c-b54f67f71379"}], "security_groups": [{"name": "tempest-securitygroup--946161204"}], "key_name": "tempest-keypair-1607199296", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:02.809461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0270d931-9243-46df-a235-2eb5d96b6298 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.228666 Apr 30 13:12:02.810305 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 19/48] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:12:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:12:02.833245 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-972bde7e-98ac-490a-9ae2-7bb3c0128b7e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:02.844700 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-972bde7e-98ac-490a-9ae2-7bb3c0128b7e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:03.112832 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-972bde7e-98ac-490a-9ae2-7bb3c0128b7e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:03.122733 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-972bde7e-98ac-490a-9ae2-7bb3c0128b7e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1238 microversion: 2.1 time: 0.299649 Apr 30 13:12:03.133711 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 20/49] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:02 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1238 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:03.139310 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:03.140204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:03.150131 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:03.150784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:03.151719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:03.152362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:03.160508 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] validate_networks() for [('384ed945-7697-4aed-a91c-b54f67f71379', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:12:03.871060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:03.884929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9bf34546-1eb9-4e2e-a051-a8dd5151a84f tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.746523 Apr 30 13:12:03.885624 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 21/50] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:03 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:03.894444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:03.898671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:03.918231 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:03.918676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:03.922257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:03.922720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:04.532766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:04.543314 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7813e5c9-8791-49b1-89a2-24b3a8d2267f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.656544 Apr 30 13:12:04.544637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 22/51] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:03 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:04.558574 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-cc91f475-0809-45bf-8937-1686fb88b991 req-1eb96bdf-f408-4c3c-8c58-2d7ec747c4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372891ff-ece3-4307-82b1-083d958c298a", "tag": "d7b2af60-4552-417a-9aa9-646dcfac8e70"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:04.563672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:04.563672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:12:04.577670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-cc91f475-0809-45bf-8937-1686fb88b991 req-1eb96bdf-f408-4c3c-8c58-2d7ec747c4c8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:04.578397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-cc91f475-0809-45bf-8937-1686fb88b991 req-1eb96bdf-f408-4c3c-8c58-2d7ec747c4c8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:04.603785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-cc91f475-0809-45bf-8937-1686fb88b991 req-1eb96bdf-f408-4c3c-8c58-2d7ec747c4c8 service nova] Creating event network-changed:d7b2af60-4552-417a-9aa9-646dcfac8e70 for instance 372891ff-ece3-4307-82b1-083d958c298a on hv-cinder-78445 Apr 30 13:12:04.612314 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-cc91f475-0809-45bf-8937-1686fb88b991 req-1eb96bdf-f408-4c3c-8c58-2d7ec747c4c8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064302 Apr 30 13:12:04.613691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 23/52] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:04.621229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:04.622471 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:04.634938 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:04.635732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:04.637348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:04.638037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:04.874896 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:04.891032 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a9eb7374-4603-4f9e-a22e-b0c567f4b445 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1290 microversion: 2.1 time: 0.274358 Apr 30 13:12:04.892178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 24/53] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:04 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1290 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:04.905006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:04.912955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:04.923596 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:04.924510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:04.925693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:04.926740 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:05.441359 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:12:05.442648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:12:05.444055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:12:05.445107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:12:05.446447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:12:05.479927 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:05.485468 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:05.487916 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:05.493939 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:05.563920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:12:05.579114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:12:05.619168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:12:05.621986 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:12:05.840565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f9b9d2d6-d4b4-4368-94cd-6e8c8070a94e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.144908 Apr 30 13:12:05.848785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 30/54] 10.222.0.69 () {62 vars in 1188 bytes} [Fri Apr 30 13:12:02 2021] POST /compute/v2.1/servers => generated 401 bytes in 3147 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 13:12:05.848785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:05.848785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:05.874573 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:05.876453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:05.877853 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:05.878849 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:05.880109 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:05.917602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e96fd4ee-9c33-4e9b-a166-7750ae72e4af tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.018164 Apr 30 13:12:05.930696 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 25/55] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:04 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:05.938793 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:05.939355 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:06.236881 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:06.267894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:06.274166 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:06.282987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c243a6ca-2d37-4179-9202-d856cef62e52 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1281 microversion: 2.20 time: 0.350413 Apr 30 13:12:06.288280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 26/56] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:05 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1281 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:06.306291 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:06.308491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:06.364712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:06.366011 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:06.370089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:06.371286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:06.801720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:06.832374 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-85a25763-d3af-4fa7-9cfe-f40ab2008fdf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1296 microversion: 2.1 time: 0.540625 Apr 30 13:12:06.833981 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:06.844699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 27/57] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:06 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1296 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:06.864094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d39d034f-a21f-4ecd-b64e-5a90259d4c0e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 1.018572 Apr 30 13:12:06.869214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 31/58] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:05 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:06.963493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:06.966323 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:06.978146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:06.979072 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:06.981684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:06.982264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.232099 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-bb5786cf-1d6f-4b24-98fd-3f311e23acaa req-a2e52fa9-8da6-4683-a82c-7d47b4a02a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ecc5adf-4994-4a01-b659-44bb30c5af63", "tag": "308cbf45-0e9c-4a51-baf7-d8508b14282f"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:07.234687 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:07.234687 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:07.271610 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bb5786cf-1d6f-4b24-98fd-3f311e23acaa req-a2e52fa9-8da6-4683-a82c-7d47b4a02a7f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.272523 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bb5786cf-1d6f-4b24-98fd-3f311e23acaa req-a2e52fa9-8da6-4683-a82c-7d47b4a02a7f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.326492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-bb5786cf-1d6f-4b24-98fd-3f311e23acaa req-a2e52fa9-8da6-4683-a82c-7d47b4a02a7f service nova] Creating event network-changed:308cbf45-0e9c-4a51-baf7-d8508b14282f for instance 7ecc5adf-4994-4a01-b659-44bb30c5af63 on hv-cinder-78445 Apr 30 13:12:07.331092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bb5786cf-1d6f-4b24-98fd-3f311e23acaa req-a2e52fa9-8da6-4683-a82c-7d47b4a02a7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=87983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 13:12:07.343352 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.345146 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.346759 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.347472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.358096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.compute.rpcapi [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 13:12:07.359271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] Releasing lock "compute-rpcapi-router" {{(pid=87983) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 13:12:07.390123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6df4b031-c343-486c-ae1a-3698c496b9d6 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162350 Apr 30 13:12:07.391934 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 32/59] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:07.398976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:07.400004 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:07.412313 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.412804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.413662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.414174 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.586219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:07.606175 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:07.608741 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:07.613018 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f720d6b7-9d2c-47f5-b45b-6aa4e223765d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1333 microversion: 2.20 time: 0.219589 Apr 30 13:12:07.626434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 33/60] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:07 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:07.757952 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:07.779095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-38166f4f-f177-4a53-9a98-24ee82b54785 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.823756 Apr 30 13:12:07.780907 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 28/61] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:06 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:07.855558 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:07.858056 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:07.870078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.870916 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.872211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.872924 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.886684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:07.888233 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:07.910340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.911418 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:07.913985 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:07.915444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:08.349519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:08.363219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-edc48740-1421-4736-b9b5-1c76b1470073 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1296 microversion: 2.1 time: 0.514176 Apr 30 13:12:08.365671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 34/62] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:07 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1296 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:08.634181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:08.635170 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:08.657176 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:08.665344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:08.669108 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:08.671764 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:08.746133 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:08.761792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a310e710-d36b-4a9c-a30e-7004236cd82f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.880418 Apr 30 13:12:08.770202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 29/63] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:07 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:08.805242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:08.806791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:08.834379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:08.836319 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:08.837711 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:08.838659 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:09.246029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:09.260082 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:09.264612 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:09.267508 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7cf6c20f-db41-4fe9-935c-87f7e5de8335 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1339 microversion: 2.20 time: 0.637460 Apr 30 13:12:09.268723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 35/64] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:08 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1339 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:09.386191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:09.387122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:09.407088 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:09.407866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:09.409119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:09.414597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:09.517225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:09.533004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-38200e99-9246-4c23-9364-38d1f9a099ef tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.737350 Apr 30 13:12:09.534877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 30/65] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:08 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:09.788411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:09.791339 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:09.807064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:09.808009 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:09.809572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:09.810634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:10.428023 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:10.449805 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5fbc63d5-9552-4fc9-847e-1280b0805fe6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 1.068065 Apr 30 13:12:10.455626 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 36/66] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:09 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:10.478471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:10.480353 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:10.508926 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:10.509706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:10.512491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:10.513222 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:10.605990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:10.632102 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6f153e90-b796-4e15-9a8a-651b3739182b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.849355 Apr 30 13:12:10.647256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 31/67] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:09 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:10.657130 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:10.662994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:10.681773 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:10.682570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:10.683652 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:10.684323 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:11.057048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:11.073991 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:11.079189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:11.080777 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f9fe3e8c-b7e4-4b29-a3cc-fd840863d18e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1339 microversion: 2.20 time: 0.623345 Apr 30 13:12:11.082340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 37/68] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:10 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1339 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:11.610222 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:11.634780 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-68fea3dc-cd2c-49c3-82f2-87dfd32399f6 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.981791 Apr 30 13:12:11.636785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 32/69] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:10 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:11.644812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:11.646274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:11.662139 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:11.663286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:11.664955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:11.666083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:11.909766 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-6535f038-3e57-4948-99c6-8eee2a7d5053 req-b7828212-ebb1-4cdc-a8b6-5be7309064e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb724af6-2bbc-494b-a119-b61199e13df1", "name": "network-vif-plugged", "status": "completed", "tag": "e06c1645-fc5c-4d22-b639-0e71e1bddb8f"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:11.912275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:11.912275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:11.938160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6535f038-3e57-4948-99c6-8eee2a7d5053 req-b7828212-ebb1-4cdc-a8b6-5be7309064e3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:11.938850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6535f038-3e57-4948-99c6-8eee2a7d5053 req-b7828212-ebb1-4cdc-a8b6-5be7309064e3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:11.969473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-6535f038-3e57-4948-99c6-8eee2a7d5053 req-b7828212-ebb1-4cdc-a8b6-5be7309064e3 service nova] Creating event network-vif-plugged:e06c1645-fc5c-4d22-b639-0e71e1bddb8f for instance fb724af6-2bbc-494b-a119-b61199e13df1 on hv-cinder-78445 Apr 30 13:12:11.975002 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-6535f038-3e57-4948-99c6-8eee2a7d5053 req-b7828212-ebb1-4cdc-a8b6-5be7309064e3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.889984 Apr 30 13:12:11.975923 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 38/70] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:11.984293 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:11.985388 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:11.997631 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:11.998261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:11.999221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:11.999825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.436131 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:12.448696 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9e27b5c8-f952-4e73-b805-3da6f4fdcf17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.809861 Apr 30 13:12:12.449902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 33/71] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:11 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:12.461640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:12.463124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:12.472786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:12.473926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.475174 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:12.475895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.655707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:12.666604 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:12.668170 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:12.669395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e8042201-1735-4b36-9c21-bc62af20c6e4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1339 microversion: 2.20 time: 0.218246 Apr 30 13:12:12.680061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 34/72] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:12 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:12.789234 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:12.805305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-590669c5-8ddf-479f-bcd1-6bed8e0e8211 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.825040 Apr 30 13:12:12.806249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 39/73] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:11 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:12.810902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:12.815240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:12.839702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:12.840416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.841417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:12.842001 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.863000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-11634cad-4777-4a5c-9e56-7e8b463ca86c req-55d44953-f5d5-46b4-96cf-0b08b73df82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9504e6a6-a9cf-4f1a-a169-eea54daf121c", "tag": "cff078e8-b239-45de-a9b9-daa6482b64f4"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:12.865833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:12.865833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:12:12.892714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-11634cad-4777-4a5c-9e56-7e8b463ca86c req-55d44953-f5d5-46b4-96cf-0b08b73df82c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:12.895618 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-11634cad-4777-4a5c-9e56-7e8b463ca86c req-55d44953-f5d5-46b4-96cf-0b08b73df82c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:12.932971 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-11634cad-4777-4a5c-9e56-7e8b463ca86c req-55d44953-f5d5-46b4-96cf-0b08b73df82c service nova] Creating event network-changed:cff078e8-b239-45de-a9b9-daa6482b64f4 for instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c on hv-cinder-78445 Apr 30 13:12:12.940115 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-11634cad-4777-4a5c-9e56-7e8b463ca86c req-55d44953-f5d5-46b4-96cf-0b08b73df82c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267306 Apr 30 13:12:12.942479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 35/74] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:13.469048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:13.471298 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:13.503390 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:13.508298 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:13.513554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:13.514431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:13.830338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:13.851276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-93734f72-d3ec-4661-97f1-264c29330d27 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 1.042265 Apr 30 13:12:13.854403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 40/75] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:12 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:13.867372 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:13.867992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:13.883319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:13.884386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:13.887112 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:13.887757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:14.182485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:14.237854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9a403003-e925-4e75-89c1-1c3d72c819a1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.772416 Apr 30 13:12:14.245513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 36/76] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:13 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:14.250512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:14.251949 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:14.277717 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:14.278441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:14.279398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:14.279983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:14.586288 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:14.596999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:14.600672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:14.611449 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ea0f8d4e-cc4b-48e5-b109-c3a3a5bf42b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.753514 Apr 30 13:12:14.614024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 41/77] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:13 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:14.618940 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-6d757a64-24e0-4e93-a98c-db6b87478276 req-7249e9f0-41a0-4df7-8c22-4b003b5e9aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372891ff-ece3-4307-82b1-083d958c298a", "name": "network-vif-plugged", "status": "completed", "tag": "d7b2af60-4552-417a-9aa9-646dcfac8e70"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:14.620782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:14.620782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:14.674421 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6d757a64-24e0-4e93-a98c-db6b87478276 req-7249e9f0-41a0-4df7-8c22-4b003b5e9aad service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:14.675447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6d757a64-24e0-4e93-a98c-db6b87478276 req-7249e9f0-41a0-4df7-8c22-4b003b5e9aad service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:14.728044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-6d757a64-24e0-4e93-a98c-db6b87478276 req-7249e9f0-41a0-4df7-8c22-4b003b5e9aad service nova] Creating event network-vif-plugged:d7b2af60-4552-417a-9aa9-646dcfac8e70 for instance 372891ff-ece3-4307-82b1-083d958c298a on hv-cinder-78445 Apr 30 13:12:14.736920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-6d757a64-24e0-4e93-a98c-db6b87478276 req-7249e9f0-41a0-4df7-8c22-4b003b5e9aad service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121305 Apr 30 13:12:14.738858 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 42/78] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:14.871570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:14.873007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:14.873296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:14.885925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-13a41d94-37d0-4920-b374-d4fbb67e59c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.637407 Apr 30 13:12:14.891400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 37/79] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:14 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:14.894709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:14.899678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:14.900998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:14.903505 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:15.260234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:15.260920 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:15.283281 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:15.284286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:15.287422 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:15.290674 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:15.627267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:15.638756 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a1f86a16-874e-4959-925c-f142e27075b4 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1315 microversion: 2.1 time: 0.771962 Apr 30 13:12:15.651841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 43/80] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:14 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:15.665744 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:15.666387 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:15.684916 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:15.685358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:15.686347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:15.686928 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.226213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:16.242282 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-560e06a9-21a0-4a42-88f4-bff5390dd82a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.985576 Apr 30 13:12:16.253761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 38/81] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:15 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:16.265331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:16.267759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:16.269082 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:16.277228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:16.279483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:16.281094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-40bbb968-ddb6-44af-9817-b6f560ed1c46 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.628121 Apr 30 13:12:16.282288 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 44/82] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:15 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:16.290571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:16.291306 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.297473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:16.301077 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.424283 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-17c3a0b3-acb6-4aa4-8c45-5aa1768eeeca req-a6c9eb79-e6d1-43e1-ae5e-c52e632cc7cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:16.426168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:16.426168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:16.443339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-17c3a0b3-acb6-4aa4-8c45-5aa1768eeeca req-a6c9eb79-e6d1-43e1-ae5e-c52e632cc7cd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:16.443798 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-17c3a0b3-acb6-4aa4-8c45-5aa1768eeeca req-a6c9eb79-e6d1-43e1-ae5e-c52e632cc7cd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.483739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-17c3a0b3-acb6-4aa4-8c45-5aa1768eeeca req-a6c9eb79-e6d1-43e1-ae5e-c52e632cc7cd service nova] Creating event network-changed:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:12:16.497898 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-17c3a0b3-acb6-4aa4-8c45-5aa1768eeeca req-a6c9eb79-e6d1-43e1-ae5e-c52e632cc7cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077169 Apr 30 13:12:16.499179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 45/83] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:12:16.661220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:16.662127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:16.675472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:16.676463 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.677550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:16.678215 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:16.770165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:16.787926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6859469e-d133-4415-84fc-1dc363ca4c65 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.529963 Apr 30 13:12:16.788523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 39/84] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:16 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:17.168553 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:17.180107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-329e7b76-e3fa-4862-bf2c-db38d020b729 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1503 microversion: 2.1 time: 0.524706 Apr 30 13:12:17.184760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 46/85] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:16 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1503 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:17.261963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:17.263107 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:17.282217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:17.283466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:17.284489 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:17.288624 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:17.304095 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:17.304829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:17.327762 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:17.328597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:17.329618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:17.330217 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:18.463748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:18.474461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9fb05c2c-2602-4af3-8b2e-c1ca811fe398 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 1.218124 Apr 30 13:12:18.487167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 40/86] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:17 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:18.495393 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:18.496578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:18.504613 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:18.505358 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:18.506577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:18.507199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:18.512005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:18.525641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:18.531876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:18.533062 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-956b6769-8c54-4741-8cd5-ded9f055d09e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 1.237271 Apr 30 13:12:18.534340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 47/87] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:17 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:12:18.539695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-e99538be-445f-45d1-afec-580bcb2f5c33 req-cf3ba2e8-bb38-40b9-b59f-25818d43d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ecc5adf-4994-4a01-b659-44bb30c5af63", "name": "network-vif-plugged", "status": "completed", "tag": "308cbf45-0e9c-4a51-baf7-d8508b14282f"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:18.541542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:18.541542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:18.553005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e99538be-445f-45d1-afec-580bcb2f5c33 req-cf3ba2e8-bb38-40b9-b59f-25818d43d7a8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:18.554472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e99538be-445f-45d1-afec-580bcb2f5c33 req-cf3ba2e8-bb38-40b9-b59f-25818d43d7a8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:18.583459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-e99538be-445f-45d1-afec-580bcb2f5c33 req-cf3ba2e8-bb38-40b9-b59f-25818d43d7a8 service nova] Creating event network-vif-plugged:308cbf45-0e9c-4a51-baf7-d8508b14282f for instance 7ecc5adf-4994-4a01-b659-44bb30c5af63 on hv-cinder-78445 Apr 30 13:12:18.591954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-e99538be-445f-45d1-afec-580bcb2f5c33 req-cf3ba2e8-bb38-40b9-b59f-25818d43d7a8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056075 Apr 30 13:12:18.602461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 48/88] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:19.062824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:19.076790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b6a41c1e-5477-4d39-85b9-6272b6a94802 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1322 microversion: 2.1 time: 0.588153 Apr 30 13:12:19.086164 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 41/89] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:18 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:19.405215 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e15cbb31-d1a1-42f2-9d77-3eca0f1e1e74"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:19.407578 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:19.417569 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:19.417908 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:19.430081 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:19.430582 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:19.492604 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:19.493748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:19.510060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:19.513123 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:19.514283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:19.514877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:20.025642 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5a6898f4-5d16-4aea-923e-f22bb27460bc tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "POST /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623834 Apr 30 13:12:20.031094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 49/90] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:12:19 2021] POST /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:20.046063 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:20.047664 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:20.077219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:20.080021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:20.081814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:20.086969 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:20.475769 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:20.512812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-22341c88-f09a-4931-9404-b55708d3eea6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 1.024485 Apr 30 13:12:20.513481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 42/91] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:19 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:20.527147 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:20.527773 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:20.545767 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:20.546405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:20.547385 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:20.547982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:20.736449 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:20.750495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:20.752223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:20.753413 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d3703b64-5292-4aea-a95c-40e6a812ea89 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.719318 Apr 30 13:12:20.754574 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 50/92] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:20 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:20.922280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:20.968942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ea63a262-b0be-471d-afa7-6436357cb881 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1516 microversion: 2.1 time: 0.453996 Apr 30 13:12:20.982525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 43/93] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:20 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1516 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:20.997314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:20.998587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:21.009150 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.009650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:21.010437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.010869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:21.090146 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'flavor' on Instance uuid 7ecc5adf-4994-4a01-b659-44bb30c5af63 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:12:21.376515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-51f6105f-56f8-4457-8803-a1020cd42750 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63/action" status: 200 len: 32 microversion: 2.1 time: 0.383815 Apr 30 13:12:21.377155 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 51/94] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:20 2021] POST /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:21.386965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:21.388003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:21.407170 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.408363 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:21.409942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.410998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:21.531941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:21.533084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:21.565032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.571791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:21.574046 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:21.576094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:22.377295 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:22.390533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c560ed9e-378d-4829-a692-e84f5a195145 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 1.008112 Apr 30 13:12:22.400526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:22.401741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 44/95] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:21 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:22.407461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:22.408290 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:22.410403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3e7e0314-6696-4781-bd37-abdc0eda51ac tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.884489 Apr 30 13:12:22.411143 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 52/96] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:21 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:22.419742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-fd9ea1bc-f2de-4dea-abc4-26d653282cf9 req-ad6fcb9a-098d-4aed-b7f1-15f1bd556836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9504e6a6-a9cf-4f1a-a169-eea54daf121c", "name": "network-vif-plugged", "status": "completed", "tag": "cff078e8-b239-45de-a9b9-daa6482b64f4"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:22.421681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:22.421681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:22.426588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:22.427207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:22.428159 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:22.428956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:22.434251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fd9ea1bc-f2de-4dea-abc4-26d653282cf9 req-ad6fcb9a-098d-4aed-b7f1-15f1bd556836 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:22.435527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fd9ea1bc-f2de-4dea-abc4-26d653282cf9 req-ad6fcb9a-098d-4aed-b7f1-15f1bd556836 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:22.474051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-fd9ea1bc-f2de-4dea-abc4-26d653282cf9 req-ad6fcb9a-098d-4aed-b7f1-15f1bd556836 service nova] Creating event network-vif-plugged:cff078e8-b239-45de-a9b9-daa6482b64f4 for instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c on hv-cinder-78445 Apr 30 13:12:22.485458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-fd9ea1bc-f2de-4dea-abc4-26d653282cf9 req-ad6fcb9a-098d-4aed-b7f1-15f1bd556836 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072779 Apr 30 13:12:22.489472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 53/97] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:22.976525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:22.992610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:22.996776 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:23.000892 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-653e1cd7-1b6b-4572-b81a-86a601291b5e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.597026 Apr 30 13:12:23.006283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 45/98] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:22 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:23.411935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:23.413055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:23.428064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:23.429057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:23.434401 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:23.435593 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:23.443527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:23.445040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:23.447474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:23.448030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:23.448870 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:23.449310 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:24.061491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:24.065419 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:24.074757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1c12b186-e0c7-424b-afaf-93051f00bddb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.651062 Apr 30 13:12:24.075347 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 46/99] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:23 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:24.076824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-25a9b863-5d1d-4209-a7a4-54355c44b807 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.671475 Apr 30 13:12:24.077767 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 54/100] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:23 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:24.081705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:24.082554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:24.090684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:24.091421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:24.092375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:24.092952 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:24.333398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:24.347857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:24.349569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:24.350855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-768602dd-acd9-4fb7-aec6-ac00a793278d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.274539 Apr 30 13:12:24.351601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 47/101] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:24 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:25.127304 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:25.128592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:25.134145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:25.135469 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:25.168656 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.169504 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.170931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.171706 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.174959 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.175532 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.176572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.177168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.606960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:25.618674 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a2d58138-bd3d-4399-b4db-95936a3b4239 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.508118 Apr 30 13:12:25.621327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 55/102] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:25 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:25.634089 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:25.634748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:25.635377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:25.643838 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.645046 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.647570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:25.648716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:25.659877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dbe82d72-3e0d-4ec5-9bcd-f5a705a2b74c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.539612 Apr 30 13:12:25.661138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 48/103] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:25 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:25.903118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:25.917145 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:25.917626 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:25.919652 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d6519dc1-6627-4cc5-9ee7-5714d3cbecb6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.296290 Apr 30 13:12:25.920542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 56/104] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:25 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:26.644448 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:26.645572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:26.664394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:26.665200 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:26.666722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:26.667823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:26.681331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:26.682390 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:26.695360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:26.697260 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:26.698718 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:26.699688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:27.092718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:27.116091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:27.121875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0d2036e5-d7cb-42e1-8e2f-32e458b31d47 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.483641 Apr 30 13:12:27.123382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 49/105] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:26 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:27.130028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:27.130810 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:27.141601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:27.142588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:27.143764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:27.145020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:27.145973 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e03eab91-14ce-4350-a376-b052b36bea2d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.471015 Apr 30 13:12:27.162498 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 57/106] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:26 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:27.475742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:27.494570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:27.498323 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:27.500967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-86568c79-339f-42e6-971d-af7e7e5831fb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.375604 Apr 30 13:12:27.514280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 50/107] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:27 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:27.626572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-c11c3d6d-3646-4ea6-8786-39f67a97d578 req-2ce893f1-129c-4c3d-92f1-6afd1426790d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "name": "network-vif-plugged", "status": "completed", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:27.628274 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:27.628274 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:27.638502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-c11c3d6d-3646-4ea6-8786-39f67a97d578 req-2ce893f1-129c-4c3d-92f1-6afd1426790d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:27.638674 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-c11c3d6d-3646-4ea6-8786-39f67a97d578 req-2ce893f1-129c-4c3d-92f1-6afd1426790d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:27.661767 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-c11c3d6d-3646-4ea6-8786-39f67a97d578 req-2ce893f1-129c-4c3d-92f1-6afd1426790d service nova] Creating event network-vif-plugged:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:12:27.667310 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-c11c3d6d-3646-4ea6-8786-39f67a97d578 req-2ce893f1-129c-4c3d-92f1-6afd1426790d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045214 Apr 30 13:12:27.668334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 58/108] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:28.146956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:28.147646 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:28.156451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.156918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.157741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.158177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.172784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:28.173540 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:28.184728 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.185314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.186363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.186886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.481295 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:28.493990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:28.495293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ccae6bf6-a4ef-4ca0-8624-74ed27549705 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.352537 Apr 30 13:12:28.503922 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bd3e0970-d489-4aaa-8b4c-eeefe7619c57 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.335284 Apr 30 13:12:28.504660 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 59/109] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:28 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:28.504915 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 51/110] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:28 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:28.530670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:28.531239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:28.540301 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.541016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.542383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:28.545132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:28.750773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:28.760827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:28.762374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:28.763471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-36b274e0-00e8-4f5c-974c-937877f95829 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.237175 Apr 30 13:12:28.764080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 60/111] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:28 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:29.512591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:29.513246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:29.521279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.521799 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.522276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:29.522837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.522935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:29.523028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.530965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.531405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.532208 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.532653 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.845143 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:29.854730 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-045030fc-bda2-4ade-b786-4fd731381a55 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.345897 Apr 30 13:12:29.855579 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 52/112] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:29 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:29.860049 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:29.860580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:29.862990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:29.868273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.868750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.869572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:29.870019 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:29.878029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-315fdb4d-965c-4cef-b837-261672a62461 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.360085 Apr 30 13:12:29.878774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 61/113] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:29 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:30.108529 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:30.118330 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:30.119929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:30.121049 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c225dda2-8efb-489b-91b4-fe9e0cf8712e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.264792 Apr 30 13:12:30.121657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 53/114] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:29 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:30.880161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:30.881492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:30.890002 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:30.890463 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:30.891230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:30.891663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:30.895625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:30.896213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:30.904339 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:30.904795 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:30.905628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:30.906064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:31.330483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:31.334394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:31.341161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4cf29747-3468-43c2-a154-fdee526ccebf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1364 microversion: 2.1 time: 0.449202 Apr 30 13:12:31.342013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 54/115] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:30 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:31.343414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a0604ae0-58f6-4a06-b787-368f90601a5c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.467416 Apr 30 13:12:31.347213 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 62/116] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:30 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:31.348563 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:31.349502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:31.360125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:31.360580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:31.361349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:31.361857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:31.577625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:31.587053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:31.588583 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:31.589658 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-391b3c8e-14cf-4ca1-94e6-0b9517b9bdbe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.246379 Apr 30 13:12:31.590196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 55/117] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:31 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:32.360289 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:32.360870 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:32.361425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:32.362311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:32.370770 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.371947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.373404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.374315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.376085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.376595 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.377610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.378085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.787758 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:32.798812 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:32.814927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ad8c8ef9-4b3f-4546-aec2-3c7c84b60ee5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1550 microversion: 2.1 time: 0.458054 Apr 30 13:12:32.815801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 56/118] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:32 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1550 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:32.832193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:32.833312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:32.836409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b402ecba-273b-4188-9152-0aaca4c1c1d6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.478915 Apr 30 13:12:32.837689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 63/119] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:32 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:32.855379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:32.856247 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:32.865582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.866600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.868288 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.873024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.873786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.875267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:32.876230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:32.882653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:33.221225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-21349be9-a3e0-4d09-a955-c8af33cd3be0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.380670 Apr 30 13:12:33.229437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 64/120] 10.222.0.69 () {58 vars in 1275 bytes} [Fri Apr 30 13:12:32 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-interface => generated 284 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:33.275757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:33.299091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:33.304048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:33.312351 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-94bf8e52-602c-46ae-9af2-b9a75031a625 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1406 microversion: 2.20 time: 0.488268 Apr 30 13:12:33.312880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 57/121] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:32 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:33.856343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:33.858750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:33.866119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:33.866620 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:33.867634 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:33.868064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.145631 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:34.147680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:34.158349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.159375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.160487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.161171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.237436 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:12:34.409364 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fd11c403-257a-4534-bdf7-e87919680bb5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 204 len: 0 microversion: 2.1 time: 0.266896 Apr 30 13:12:34.413885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 58/122] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:12:34 2021] DELETE /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:12:34.427668 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:34.429054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:34.439066 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.439532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.440522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.441504 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.492736 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:34.503079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-309a2b1d-8017-4e2e-8cc9-8ea4e462ee75 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.649872 Apr 30 13:12:34.514203 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 65/123] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:33 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:34.521294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:34.522448 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:34.539423 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.540156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:34.541172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:34.541826 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.474070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:35.484759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:35.496084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8d497343-0561-4b40-8e15-2aeb37d037a1 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1555 microversion: 2.1 time: 0.980208 Apr 30 13:12:35.498026 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 66/124] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:34 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1555 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:35.501416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:35.510984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:35.516824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6c4a3f48-0c52-467a-9085-c5c5468aed3d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1598 microversion: 2.20 time: 1.099917 Apr 30 13:12:35.521692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 59/125] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:12:34 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1598 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:12:35.521893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:35.522493 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:35.538968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:35.540014 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:35.544461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.545129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.546168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.546760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.555056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.564627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.566186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.567329 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.954859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-43568902-4728-4006-aaf2-5bcb38b4cf17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.420425 Apr 30 13:12:35.957432 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 60/126] 10.222.0.69 () {60 vars in 1316 bytes} [Fri Apr 30 13:12:35 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:12:35.967973 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:35.969417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:35.983067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.984299 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:35.985453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:35.986099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:36.083272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:36.095911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a53b71d0-d1d4-433b-9eeb-fe36b9f20bd2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.578948 Apr 30 13:12:36.097527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 67/127] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:35 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:36.103360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-e7d805d2-1d24-4205-85cd-3d2a50cd70d1 req-eb962ed2-2406-4f7c-af3d-3333391e309a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9504e6a6-a9cf-4f1a-a169-eea54daf121c", "tag": "cff078e8-b239-45de-a9b9-daa6482b64f4"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:36.105033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:36.105033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:36.115072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e7d805d2-1d24-4205-85cd-3d2a50cd70d1 req-eb962ed2-2406-4f7c-af3d-3333391e309a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:36.116044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e7d805d2-1d24-4205-85cd-3d2a50cd70d1 req-eb962ed2-2406-4f7c-af3d-3333391e309a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:36.136109 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-e7d805d2-1d24-4205-85cd-3d2a50cd70d1 req-eb962ed2-2406-4f7c-af3d-3333391e309a service nova] Creating event network-changed:cff078e8-b239-45de-a9b9-daa6482b64f4 for instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c on hv-cinder-78445 Apr 30 13:12:36.142742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-e7d805d2-1d24-4205-85cd-3d2a50cd70d1 req-eb962ed2-2406-4f7c-af3d-3333391e309a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043289 Apr 30 13:12:36.144755 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 68/128] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:36.247381 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f02aadf8-0f48-429b-a2a6-a7600932a4fe tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.288203 Apr 30 13:12:36.248622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 61/129] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:35 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:36.518537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:36.520494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:36.529118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:36.530159 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:36.531169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:36.531712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:37.115885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:37.117361 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:37.140565 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:37.141037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:37.144311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:37.144869 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:37.859181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:37.879944 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-40fa21eb-c1ec-47f9-ac96-08b9a6ef86d5 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1555 microversion: 2.1 time: 1.363460 Apr 30 13:12:37.881100 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 69/130] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:36 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1555 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:37.890675 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:37.891621 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:37.941954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:37.948502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:37.950164 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:37.951016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:38.102125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:38.112732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ddf8323a-d153-4dde-982c-09ee38c2ece7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 1.002268 Apr 30 13:12:38.119894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 62/131] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:37 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:38.278140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-46facad9-8c5f-477a-8a9e-4167c134297e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.394715 Apr 30 13:12:38.279481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 70/132] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:37 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:38.898824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:38.899899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:38.917232 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:38.917883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:38.919160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:38.919823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.153667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:39.157666 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:39.169040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:39.169895 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.171302 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:39.172453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.395792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:39.416099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-097c8ce6-44b6-4585-b3b7-fde1c9bfb093 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1513 microversion: 2.1 time: 0.520955 Apr 30 13:12:39.430983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 63/133] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:38 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1513 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:39.444990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-e46594df-bd1f-489d-98f5-8a799e64b762 req-c7d33cfe-3fe4-4b03-9f96-01397b8593fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb724af6-2bbc-494b-a119-b61199e13df1", "name": "network-vif-deleted", "tag": "e06c1645-fc5c-4d22-b639-0e71e1bddb8f"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:39.450054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:39.450054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:12:39.469062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e46594df-bd1f-489d-98f5-8a799e64b762 req-c7d33cfe-3fe4-4b03-9f96-01397b8593fc service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:39.470083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e46594df-bd1f-489d-98f5-8a799e64b762 req-c7d33cfe-3fe4-4b03-9f96-01397b8593fc service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.509160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-e46594df-bd1f-489d-98f5-8a799e64b762 req-c7d33cfe-3fe4-4b03-9f96-01397b8593fc service nova] Creating event network-vif-deleted:e06c1645-fc5c-4d22-b639-0e71e1bddb8f for instance fb724af6-2bbc-494b-a119-b61199e13df1 on hv-cinder-78445 Apr 30 13:12:39.519106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-e46594df-bd1f-489d-98f5-8a799e64b762 req-c7d33cfe-3fe4-4b03-9f96-01397b8593fc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085156 Apr 30 13:12:39.520940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 64/134] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:39.532072 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:39.534465 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:39.549109 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:39.550323 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.552028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:39.553451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:39.795015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ef357ee7-81b5-4862-8e4e-5ede1168e8cf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.270414 Apr 30 13:12:39.800081 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 65/135] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:39 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:39.994183 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:40.021868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a13a3187-9923-41a6-8813-4b4409c9a8b6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.879173 Apr 30 13:12:40.024595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 71/136] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:39 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:40.312198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:40.316243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:40.317081 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-cf2c3cdf-dc7c-4d00-8c3e-2d7da5276bb8 req-d901e7eb-9362-4ebd-bfc3-c2046314c2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:40.328834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:12:40.328834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:12:40.339765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.341126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.343594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.344714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.383705 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-cf2c3cdf-dc7c-4d00-8c3e-2d7da5276bb8 req-d901e7eb-9362-4ebd-bfc3-c2046314c2fa service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.384834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-cf2c3cdf-dc7c-4d00-8c3e-2d7da5276bb8 req-d901e7eb-9362-4ebd-bfc3-c2046314c2fa service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.439537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-cf2c3cdf-dc7c-4d00-8c3e-2d7da5276bb8 req-d901e7eb-9362-4ebd-bfc3-c2046314c2fa service nova] Creating event network-changed:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:12:40.445780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-cf2c3cdf-dc7c-4d00-8c3e-2d7da5276bb8 req-d901e7eb-9362-4ebd-bfc3-c2046314c2fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142836 Apr 30 13:12:40.449868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 72/137] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:12:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:12:40.457221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:40.461209 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:40.483909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.490827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.492094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.492723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.719325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bba1d747-a675-4e62-bf6a-b6febef62227 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 0.415738 Apr 30 13:12:40.724354 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 66/138] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:40 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:40.758271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.759069 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.759982 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lazy-loading 'fault' on Instance uuid fb724af6-2bbc-494b-a119-b61199e13df1 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:12:40.810016 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:40.811352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:40.821562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.822268 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:40.823228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:40.823872 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:41.104670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a73eb674-2bdd-4638-a423-a8110b7e4c3b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.299723 Apr 30 13:12:41.106724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 67/139] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:40 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:12:41.127179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:41.129151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:41.185030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:41.189249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:41.194186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:41.196725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:41.236813 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2715b60815d47b2a0e59f2bfa640a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fa2f85932184fbeaadca042ca7ca85e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:41.270963 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8ad19c57-cdc4-4bf2-93cb-4aa475edb1d2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 200 len: 1351 microversion: 2.1 time: 0.818916 Apr 30 13:12:41.276652 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 73/140] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:40 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 1351 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:41.740266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:41.746458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:41.785248 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:41.786058 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:41.787427 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:41.788296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:42.066292 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:42.085441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-49f33a47-f84e-4627-907d-9d00bf197d25 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.976448 Apr 30 13:12:42.103250 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 68/141] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:41 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:42.116380 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b166853a-5691-4639-9a01-e32f868dc315 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 0.382844 Apr 30 13:12:42.122321 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 74/142] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:41 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:42.132060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:42.134121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:42.150871 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:42.151989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:42.153751 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:42.155932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:42.302268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:42.305833 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:42.314624 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:42.315076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:42.315872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:42.316304 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:42.369162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e6f78936-86e9-4604-9b02-ab3fab822959 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.244229 Apr 30 13:12:42.369524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 69/143] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:42 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:42.451561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] HTTP exception thrown: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. Apr 30 13:12:42.452561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Returning 404 to user: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:12:42.454160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c1f84914-e9d9-4995-9e00-8c7186022b08 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 404 len: 111 microversion: 2.1 time: 0.159606 Apr 30 13:12:42.455207 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 75/144] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:42 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:12:43.120582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:43.134708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:43.136042 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:43.137068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:43.155367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:43.156081 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:43.157485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:43.158222 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:43.176142 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:43.178769 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:43.180967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:43.185073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:44.168786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:44.180010 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-28b8ec08-cb44-4766-88cb-5bd593fd855a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 1.067345 Apr 30 13:12:44.180617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 70/145] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:43 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:44.185899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:44.187150 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:44.197122 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:44.197865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:44.199099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:44.199577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:45.876625 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-27907f9d-2bd9-4f23-8a16-d106fe093ab5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 2.749375 Apr 30 13:12:45.877267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 76/146] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:43 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 2751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:45.882632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:45.883390 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:45.891915 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:45.892370 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:45.893192 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:45.893679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:45.901303 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3fe2a6c9-8293-4860-8052-66216411b3a7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 1.719339 Apr 30 13:12:45.902441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 71/147] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:44 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:46.119328 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:46.128573 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2d0d8222-ed58-4f3e-a97b-63e65584a564 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.250001 Apr 30 13:12:46.129290 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 77/148] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:45 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:46.894267 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:46.896743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:46.913998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:46.915115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:46.916259 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:46.916671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:46.916806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:46.916939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:46.924147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:46.924850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:46.926121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:46.926596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:47.080136 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52dc6ee1-c35a-4638-a7a6-7bb62d3900b8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 14 microversion: 2.1 time: 0.169181 Apr 30 13:12:47.081086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 78/149] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:46 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:12:47.108693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-136e6f6e-5bea-47bd-be80-7ce41d8d04cb tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 0.222401 Apr 30 13:12:47.109336 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 72/150] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:46 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:47.151995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:47.152708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:47.162161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:47.162615 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:47.163526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:47.163885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:47.396181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:47.411765 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d848d14f-30e9-47f9-a015-9fa9d4181382 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.264664 Apr 30 13:12:47.413260 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 79/151] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:47 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:47.995817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:47.996825 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:48.013692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.014481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.016326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.017156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.072632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] HTTP exception thrown: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. Apr 30 13:12:48.073263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Returning 404 to user: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:12:48.074188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a3f7b91e-de27-4c38-bd6c-13c569d0b34a tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "DELETE /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 404 len: 111 microversion: 2.1 time: 0.085744 Apr 30 13:12:48.074782 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 73/152] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:12:47 2021] DELETE /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:12:48.086081 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:48.088305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] [instance: fb724af6-2bbc-494b-a119-b61199e13df1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:48.095596 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:48.097048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:48.103804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.104845 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.106095 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.106805 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.111089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.111730 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.112739 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.113399 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.165919 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] HTTP exception thrown: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. Apr 30 13:12:48.166611 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] Returning 404 to user: Instance fb724af6-2bbc-494b-a119-b61199e13df1 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:12:48.167476 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-67772e93-82f8-4561-b93d-321036c9cbb2 tempest-DeleteServersTestJSON-641383824 tempest-DeleteServersTestJSON-641383824-project] 10.222.0.69 "GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1" status: 404 len: 111 microversion: 2.1 time: 0.087145 Apr 30 13:12:48.167999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 80/153] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:48 2021] GET /compute/v2.1/servers/fb724af6-2bbc-494b-a119-b61199e13df1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:12:48.175920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:48.177920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:48.194250 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.195528 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:48.198003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:48.199040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:51.174807 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0991d785-3a18-449f-bfee-8ce156c97663 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 6184 microversion: 2.1 time: 3.085879 Apr 30 13:12:51.175654 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 74/154] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:48 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 6184 bytes in 3088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:51.181606 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:51.182366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:51.191945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:51.192400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:51.193448 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:51.193894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:51.205779 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7abb5002-4383-4d50-9fff-f2044736ea1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 3.035911 Apr 30 13:12:51.209036 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 81/155] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:48 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 3040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:51.414619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:51.431705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9d22296c-46d0-4d9e-96d5-9b55f6b1077c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.254468 Apr 30 13:12:51.432752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 75/156] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:51 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:52.192844 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:52.201901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:52.218828 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.220363 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:52.221220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.221559 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:52.223259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.224526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.242567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.243683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.245189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.246337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.481407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e86f7a72-6e9b-4606-b807-e60b0155db4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 19133 microversion: 2.1 time: 0.296735 Apr 30 13:12:52.482092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 82/157] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:52 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 19133 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:12:52.492836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:52.494071 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:52.503680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.504259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.505141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:52.505738 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:52.522328 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f3555777-48bf-4aa7-9dd9-f2de25432857 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 14 microversion: 2.20 time: 0.306787 Apr 30 13:12:52.529316 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 76/158] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:52 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 14 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:52.849666 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:52.860503 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52317aab-8581-4b10-a524-a115805a2f46 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.376967 Apr 30 13:12:52.863398 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 83/159] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:52 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:53.502808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:53.509317 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:53.527176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.537226 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:53.538372 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:53.546752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:53.549575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.551289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:53.565952 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.566637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:53.567549 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.568153 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:53.748290 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fc55850f-7581-4a64-9ead-85293890f031 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 6451 microversion: 2.20 time: 0.215812 Apr 30 13:12:53.749218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 84/160] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:53 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 6451 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:12:53.781714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1f19d244-089b-4f44-8510-e259a95e2800 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 21110 microversion: 2.1 time: 0.289000 Apr 30 13:12:53.786337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 77/161] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:53 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 21110 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:12:53.891896 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:53.893992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:53.910541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.914440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:53.915832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:53.918170 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:54.486847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:54.501822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-37154b7e-54cc-4fcb-b1be-1f2187246a1c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.620570 Apr 30 13:12:54.503591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 85/162] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:53 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:54.768059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:54.769790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:54.786659 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:54.787472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:54.788676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:54.789197 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:54.798436 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:54.801009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:54.821892 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:54.822384 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:54.824486 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:54.828076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:54.993795 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e8843718-4cce-47c7-9bf0-075b88e78932 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 15025 microversion: 2.20 time: 0.231291 Apr 30 13:12:54.994803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 78/163] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:54 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 15025 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:12:55.070463 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0a79dffc-200f-4a2d-8a57-07fad3eb1211 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 22894 microversion: 2.1 time: 0.278778 Apr 30 13:12:55.074194 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 86/164] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:54 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 22894 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:12:55.525155 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:55.526368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:55.538550 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:55.539596 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:55.540806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:55.541505 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:55.857251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:55.867325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-79acc313-8c81-4ead-8fd5-e753736d7397 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.348548 Apr 30 13:12:55.867793 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 79/165] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:55 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:56.018758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:56.020122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:56.038506 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.039619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:56.041178 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.041795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:56.089948 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:56.091413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:56.111983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.116984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:56.118074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.118755 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:56.295598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e71d9554-0c1b-416e-939d-c42412455be2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 18083 microversion: 2.20 time: 0.287343 Apr 30 13:12:56.296913 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 87/166] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:56 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 18083 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:12:56.341103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5d22c9da-cb04-4e6b-bfd6-ec35b8c2f4f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 23885 microversion: 2.1 time: 0.257026 Apr 30 13:12:56.348722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 80/167] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:56 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 23885 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:12:56.893477 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:56.895721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:56.918568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.919665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:56.921850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:56.922934 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:57.326280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:57.338981 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:57.375695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:57.378264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:57.380018 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:57.381273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:57.872290 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2a243f10-4b51-4dfd-b702-c8c90cf4f8c5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 20552 microversion: 2.20 time: 0.563813 Apr 30 13:12:57.876379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 81/168] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:57 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 20552 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:12:57.879441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:57.880617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:57.889551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:57.890006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:57.890821 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:57.891256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:57.984626 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:57.995682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-695ade7b-51a4-4fbf-855b-f4df56b712a6 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 1.112757 Apr 30 13:12:57.996655 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 88/169] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:56 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:12:58.045982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ccd3069c-851e-4e5e-aee0-753976f10b12 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 25893 microversion: 2.1 time: 0.171348 Apr 30 13:12:58.047379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 82/170] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:57 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 25893 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:12:58.886236 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:58.887596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:58.904144 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:58.904681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:58.905581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:58.906014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:59.029404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:12:59.031535 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:59.054437 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:59.055485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:59.057054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:59.058024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:59.150592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fd444dfa-d6a9-4a4a-a886-17567361caad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 22720 microversion: 2.20 time: 0.270029 Apr 30 13:12:59.151858 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 89/171] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:12:58 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 22720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:12:59.161330 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:12:59.165227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:12:59.189804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:59.190686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:59.192022 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:12:59.197233 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:12:59.432371 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:12:59.450951 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fd752958-4fa1-4270-98a9-aebe2734e946 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1522 microversion: 2.1 time: 0.433230 Apr 30 13:12:59.453079 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 83/172] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:12:59 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:12:59.497848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-cab94916-8cd3-4a4d-ba0d-c7b4fd34c4b7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 27064 microversion: 2.1 time: 0.342775 Apr 30 13:12:59.500677 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 90/173] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:12:59 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 27064 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:00.165178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:00.166296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:00.180785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.186246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.187300 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.187899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.361980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dd6ab2fe-4b55-43bd-8df3-3178d4cdc5a1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 23802 microversion: 2.20 time: 0.200904 Apr 30 13:13:00.369360 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 84/174] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:00 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 23802 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:00.477426 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:00.478224 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:00.508114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.508645 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.509474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.509912 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.516247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:00.518445 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:00.558138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.561905 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.565964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:00.566746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:00.828670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2f14c12d-1499-49cb-b586-3e84115a98bb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 27606 microversion: 2.1 time: 0.318462 Apr 30 13:13:00.830495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 85/175] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:00 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 27606 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:00.968223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:00.980771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7124d053-24df-4edb-b5a1-9b67cdec3889 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1502 microversion: 2.1 time: 0.506159 Apr 30 13:13:00.985533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 91/176] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:00 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:01.017570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:01.018815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:01.051840 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.052695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:01.054855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.055941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:01.382382 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:01.384430 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:01.402604 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.403806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:01.405316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.406419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:01.673055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:01.683802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2bff9907-68ce-4a9e-87e1-55aae4a62f3a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 25332 microversion: 2.20 time: 0.307562 Apr 30 13:13:01.686029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 92/177] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:01 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 25332 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:01.700060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-aa0adb01-e4d0-4ee2-8f64-8d986c98b0f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1515 microversion: 2.1 time: 0.703227 Apr 30 13:13:01.716458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 86/178] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:00 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1515 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:01.847072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:01.850475 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:01.884318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.893808 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:01.895159 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:01.895907 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:02.183151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c4ed49fe-514d-4dc0-aa21-1a1b9a92eff6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 27918 microversion: 2.1 time: 0.344747 Apr 30 13:13:02.185138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 93/179] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:01 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 27918 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:02.702977 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:02.704533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:02.723321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:02.723725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:02.725891 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:02.726315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:02.960464 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-61933567-12cf-4bb8-9b7e-70f3655c004d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 26630 microversion: 2.20 time: 0.262315 Apr 30 13:13:02.961050 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 87/180] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:02 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 26630 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:03.207597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:03.226716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:03.255946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:03.258127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:03.260617 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:03.262044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:03.508101 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dfe729aa-a35c-4b1e-92ba-86c3fb782bb6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28214 microversion: 2.1 time: 0.314529 Apr 30 13:13:03.514960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 94/181] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:03 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:03.790932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:03.791955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:03.800195 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:03.800762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:03.801867 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:03.802368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:03.862758 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'flavor' on Instance uuid 372891ff-ece3-4307-82b1-083d958c298a {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:13:03.980047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:03.981820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:04.016630 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.017808 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.019683 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.020716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.058044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-cbf1d768-31c7-4c94-9d7b-4cb176dd7924 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action" status: 200 len: 32 microversion: 2.1 time: 0.270682 Apr 30 13:13:04.060661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 88/182] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:03 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action => generated 32 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:13:04.090847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:04.097407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:04.121036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.121990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.125109 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.127165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.313840 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-23e6935d-7e80-4e98-89a7-9ac7fce71714 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 27365 microversion: 2.20 time: 0.341374 Apr 30 13:13:04.321035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 95/183] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:03 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 27365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:04.538816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:04.549880 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:04.587774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.588995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.591127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:04.592211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:04.824010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8283e1c3-7f31-4173-a096-ce83685d8fde tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28505 microversion: 2.1 time: 0.296922 Apr 30 13:13:04.828253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 96/184] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:04 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:04.908116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:04.943584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4123eca2-6b27-4ca7-bc48-1476ed4fb227 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.868399 Apr 30 13:13:04.950946 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 89/185] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:04 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:05.330668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:05.331836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:05.352511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:05.353205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:05.354182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:05.354875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:05.669257 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-31e049c7-bab1-4a2a-ac29-77ae345d70cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 27763 microversion: 2.20 time: 0.343663 Apr 30 13:13:05.670228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 97/186] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:05 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 27763 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:05.839532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:05.841187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:05.862154 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:05.862916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:05.864047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:05.864648 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:05.979787 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:05.985738 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:06.014087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:06.014566 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:06.015438 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:06.018250 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:06.034115 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-68966827-62f5-49a1-a2d5-8db414217287 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28673 microversion: 2.1 time: 0.197912 Apr 30 13:13:06.035189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 90/187] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:05 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:06.425230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:06.435528 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-378e185b-e718-452d-97f7-45a8b39e6392 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.461908 Apr 30 13:13:06.436994 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 98/188] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:05 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:06.683808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:06.687105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:06.704927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:06.707753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:06.711510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:06.713188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:06.917624 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7ea7b163-1462-44c2-aeb9-79abd2ca062b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28225 microversion: 2.20 time: 0.237467 Apr 30 13:13:06.923594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 91/189] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:06 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28225 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:07.048596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:07.051079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:07.072698 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.073197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:07.075700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.076128 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:07.276114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-aa36a8cb-5676-4116-8765-0c8c58e21e17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28673 microversion: 2.1 time: 0.232775 Apr 30 13:13:07.277255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 99/190] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:07 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:07.456815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:07.457670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:07.473343 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.473854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:07.477237 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.477812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:07.772653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:07.785259 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8f7bcbac-0aec-4355-846e-ce37eb43eab1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.332818 Apr 30 13:13:07.787203 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 92/191] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:07 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:07.931984 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:07.933309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:07.942659 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.943178 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:07.944295 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:07.944878 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:08.147038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8b38cf0d-93a2-46a3-9ee1-8680e201668b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28240 microversion: 2.20 time: 0.218862 Apr 30 13:13:08.156305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 100/192] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:07 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28240 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:08.297069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:08.301989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:08.315715 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:08.316709 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:08.318075 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:08.319580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:08.555878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3e75d55c-c7d9-48c2-bfc9-7ce5ec33b498 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28673 microversion: 2.1 time: 0.267757 Apr 30 13:13:08.556808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 93/193] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:08 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:08.822093 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:08.822093 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:08.832447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:08.833624 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:08.835124 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:08.835986 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:09.123244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:09.134529 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0557c6f0-1635-4dda-98cd-9ed61b35eb4a tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.326818 Apr 30 13:13:09.141550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 101/194] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:08 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:09.164074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:09.165170 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:09.173913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:09.174375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:09.175289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:09.175739 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:09.327977 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-35923d33-e810-4c86-9f44-7957b859902f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28516 microversion: 2.20 time: 0.168123 Apr 30 13:13:09.332794 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 94/195] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:09 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:09.570497 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:09.571749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:09.580016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:09.580878 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:09.584690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:09.585095 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:09.730064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-12c5b747-dbda-40c5-bbcb-22e70ef37fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 28673 microversion: 2.1 time: 0.163282 Apr 30 13:13:09.731431 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 102/196] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:09 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 28673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:10.159331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:10.161572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:10.176858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.177609 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.179354 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.180157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.349641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:10.352830 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:10.365246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.366156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.367398 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.368008 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.626533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bffd3091-ae52-4984-96c6-6fb5874a14d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28684 microversion: 2.20 time: 0.288165 Apr 30 13:13:10.627569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:10.629432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 103/197] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:10 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28684 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:10.641452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7261b2d3-7f1f-4023-9e95-846586239458 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.492672 Apr 30 13:13:10.645010 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 95/198] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:10 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:10.749054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:10.750905 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:10.767100 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.768226 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.769711 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:10.770482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:10.964287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-eb7a9dd1-0d1e-423b-9f43-7a7657d5f8f7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 29024 microversion: 2.1 time: 0.223164 Apr 30 13:13:10.965536 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 104/199] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:10 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 29024 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:11.646984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:11.650657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:11.659965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:11.660698 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:11.666797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:11.668038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:11.669558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:11.670306 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:11.688451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:11.688451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:11.688451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:11.688451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:11.925667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e8cc9b9c-7ce2-4bdf-95b5-6d196ad40e15 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28684 microversion: 2.20 time: 0.287197 Apr 30 13:13:11.926845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 96/200] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:11 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28684 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:11.982189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:11.983789 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:12.018319 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:12.019085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:12.020368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:12.025996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:12.077418 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:12.090538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-68fda826-c3aa-4f92-9098-3a0dd0a9cf9f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.434703 Apr 30 13:13:12.092227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 105/201] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:11 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:12.314273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-67aeb853-8a71-49d3-aa47-29bf84b13db1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 31064 microversion: 2.1 time: 0.339069 Apr 30 13:13:12.316586 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 97/202] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:11 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 31064 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:12.941980 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:12.943548 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:12.971010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:12.973321 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:12.974458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:12.975638 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:13.123486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:13.124598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:13.143994 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4760f985-7717-4e32-93da-c21e6dc2190c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28684 microversion: 2.20 time: 0.207079 Apr 30 13:13:13.148510 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 106/203] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:12 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28684 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:13.148689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:13.148689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:13.149051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:13.149448 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:13.328825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:13.329953 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:13.352326 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:13.359977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:13.362043 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:13.366535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:13.634062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:13.651619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7ba93a9c-e58f-43f9-961f-a50b4493d16e tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.532452 Apr 30 13:13:13.652629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 98/204] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:13 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:13.672150 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-95865d70-d1fa-46a2-9380-121ee0793a03 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 32690 microversion: 2.1 time: 0.347574 Apr 30 13:13:13.678113 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 107/205] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:13 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 32690 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:14.157691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:14.159792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:14.170241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.171387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:14.172554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.173211 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:14.374395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-afbfe776-36b9-40a8-8d2b-2fa2f70336cd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 28684 microversion: 2.20 time: 0.220889 Apr 30 13:13:14.380087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 99/206] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:14 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 28684 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:14.693479 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:14.707302 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:14.709567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:14.714132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:14.749725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.752575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:14.757044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.757044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:14.760820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.761685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:14.763112 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:14.764981 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:15.088124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9d8e665d-790d-4f23-a2b9-58f3cef072c2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 33917 microversion: 2.1 time: 0.402993 Apr 30 13:13:15.091898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 100/207] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:14 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 33917 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:15.383678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:15.394438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:15.398833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:15.407027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2146c1cb-8ea9-4b22-8823-f05ce7e2618f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.731062 Apr 30 13:13:15.417982 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 108/208] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:14 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:15.422161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:15.424010 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:15.426334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:15.427301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:15.685400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9ba7a899-fa4b-4c7d-8ce4-caf253291303 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 29608 microversion: 2.20 time: 0.300315 Apr 30 13:13:15.686202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 101/209] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:15 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 29608 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:16.105964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:16.107277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:16.128218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.128667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.130046 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.130483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.303585 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f5987add-c749-4d82-b50b-3dcc6ad8472b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 34822 microversion: 2.1 time: 0.201523 Apr 30 13:13:16.306421 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 109/210] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:16 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 34822 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:16.427125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:16.428078 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:16.443533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.449017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.450122 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.450597 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.702888 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:16.704419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:16.725551 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.728414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.730947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:16.731616 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:16.974691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:16.991754 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5452e574-0c93-4aa5-b24f-c6e8a0b69409 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 31348 microversion: 2.20 time: 0.296797 Apr 30 13:13:16.992669 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 110/211] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:16 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 31348 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:16.994061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-15ca283e-db3c-4340-8f00-134409b2445c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.571847 Apr 30 13:13:17.007388 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 102/212] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:16 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:17.323418 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:17.325364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:17.336360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:17.337117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:17.338539 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:17.339930 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:17.528141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0eaeadd3-ba63-4548-8e64-4474db91c011 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 35575 microversion: 2.1 time: 0.210743 Apr 30 13:13:17.529541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 111/213] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:17 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 35575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:18.006791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:18.008526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:18.021266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:18.022458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:18.042344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.042971 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.043626 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.044261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.045255 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.046548 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.047239 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.047842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.421693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:18.436899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8ca0c2f2-c562-403b-8258-0199341242f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 32993 microversion: 2.20 time: 0.435269 Apr 30 13:13:18.438898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 103/214] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:18 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 32993 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:18.441668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e191a4c3-58ff-448b-984f-e4d55174ea6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.424843 Apr 30 13:13:18.442904 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 112/215] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:18 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:18.549987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:18.549987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:18.572379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.573062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.578759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:18.579423 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:18.761162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-000f8008-9d86-4e0e-b233-57f6580e1bc5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 36655 microversion: 2.1 time: 0.221479 Apr 30 13:13:18.766031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 104/216] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:18 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 36655 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:19.450869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:19.452435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:19.460893 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:19.462920 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:19.488593 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.491531 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.492162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.493166 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.493810 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.494792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.495434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.511595 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.736903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-10659a95-20a8-4e0d-ad29-547cb84d8fa0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 33435 microversion: 2.20 time: 0.290403 Apr 30 13:13:19.739414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 113/217] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:19 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 33435 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:19.775464 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:19.777101 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:19.779196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:19.786434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.787104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.788123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:19.788566 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:19.791148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-46d93ea8-e454-4f5d-9a7e-8f85b5cb2dd7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.335238 Apr 30 13:13:19.800026 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 105/218] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:19 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:20.750387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:20.751330 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:20.759790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:20.760246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:20.761038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:20.761592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:22.702454 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-75987275-2b6b-40ff-92a4-9a1db2ba8b9a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 38198 microversion: 2.1 time: 2.931338 Apr 30 13:13:22.703385 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 114/219] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:19 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 38198 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:22.709274 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:22.710188 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:22.719123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:22.719560 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:22.720358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:22.720785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:22.834455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-09015b3f-96f3-47f4-9115-215ddda773f6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 35188 microversion: 2.20 time: 2.087436 Apr 30 13:13:22.835513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 106/220] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:20 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 35188 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:23.019357 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:23.030906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-841dc7d5-0dbe-4055-b5bb-b20420f876f4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1501 microversion: 2.1 time: 0.326006 Apr 30 13:13:23.031624 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 115/221] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:22 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:23.050884 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59fcdfc-c439-4eb9-b32e-541eec82f0c0"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:23.052057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:23.061061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.061546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.062347 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.062786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.128379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] HTTP exception thrown: Cannot 'attach_volume' instance 372891ff-ece3-4307-82b1-083d958c298a while it is in vm_state rescued Apr 30 13:13:23.128982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Returning 409 to user: Cannot 'attach_volume' instance 372891ff-ece3-4307-82b1-083d958c298a while it is in vm_state rescued {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:13:23.129880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ff1ef5e0-f473-40cf-9d22-6f3ba0aa94db tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084637 Apr 30 13:13:23.130464 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 107/222] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:13:23 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 13:13:23.139789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:23.140311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:23.148467 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.148911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.149729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.150158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.356660 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-83c561a8-9438-4b9b-90a6-be3f3bc6ff93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action" status: 202 len: 0 microversion: 2.1 time: 0.220447 Apr 30 13:13:23.357484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 116/223] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:23 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:23.368626 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:23.369511 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:23.380679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.381314 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.382664 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.383101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.628229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:23.637005 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-65f4da74-5052-43fe-9b5d-298803d7fff1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1509 microversion: 2.1 time: 0.274217 Apr 30 13:13:23.637622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 108/224] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:23 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:23.717560 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:23.718723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:23.726429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.726874 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.727657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.728093 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.852023 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:23.856013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:23.863896 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.864349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:23.865146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:23.865763 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:26.385069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d46f7e47-9bb3-4a59-9188-176f5b2db7df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 37588 microversion: 2.20 time: 2.536534 Apr 30 13:13:26.387895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 109/225] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:23 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 37588 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:26.396427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:26.397772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:26.411459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52a9705f-676e-4357-98f6-953bd6d04d2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 200 len: 38328 microversion: 2.1 time: 2.698422 Apr 30 13:13:26.412134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:26.412134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:26.412947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 117/226] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:23 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 38328 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:13:26.413203 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:26.413931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:26.431025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:26.431800 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:26.446584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:26.447133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:26.448113 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:26.448761 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:26.513618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3f6f389c-0e30-4f24-99e3-b2a4ff26f9a5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/ips" status: 200 len: 145 microversion: 2.1 time: 0.090386 Apr 30 13:13:26.514296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 118/227] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:13:26 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/ips => generated 145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:13:26.925557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:26.934587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bdee82d0-5d69-41a3-9378-05f4081a77d0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1509 microversion: 2.1 time: 0.544523 Apr 30 13:13:26.935171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 110/228] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:26 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1509 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:27.406471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:27.409168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:27.428336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:27.430044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:27.431329 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:27.432518 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:27.623834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ca092752-38c8-4693-a1f1-9507e488abe4 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 38222 microversion: 2.20 time: 0.225272 Apr 30 13:13:27.625898 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 119/229] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:27 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 38222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:27.952344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:27.954138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:27.962902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:27.963790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:27.966006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:27.966458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:28.228750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:28.238382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-cdd77ae0-faf3-4287-96fd-8625e7db730f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1509 microversion: 2.1 time: 0.290079 Apr 30 13:13:28.239126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 111/230] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:27 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:28.647227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:28.651784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:28.668494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:28.670200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:28.672572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:28.673360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:28.891469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-eeebc1f7-f784-4927-9f35-ac096ecd57d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 38228 microversion: 2.20 time: 0.253674 Apr 30 13:13:28.898978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 120/231] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:28 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 38228 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:29.258506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:29.259457 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:29.271966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.273651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:29.276672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.277120 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:29.818714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:29.836651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6a6b32ac-4413-41b6-8b49-3646f5777568 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1509 microversion: 2.1 time: 0.581832 Apr 30 13:13:29.839435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 112/232] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:29 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1509 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:29.848334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c207bd4-e802-4a0d-837b-4a2e79adf31d"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:29.849673 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:29.858441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.859013 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:29.859883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.860417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:29.908228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:29.909723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:29.917747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.918412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:29.919030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:29.919461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:30.106820 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-77509667-72e2-4ca5-9893-add3eaa897a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 200 len: 38363 microversion: 2.20 time: 0.202649 Apr 30 13:13:30.113261 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 113/233] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:29 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 38363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:13:30.120724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:30.121785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:30.131577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:30.132175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:30.134074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:30.134572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:30.206167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-78a1f1f3-8827-455f-856b-7ea49be889ef tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/ips" status: 200 len: 152 microversion: 2.20 time: 0.091070 Apr 30 13:13:30.209577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 114/234] 10.222.0.69 () {60 vars in 1289 bytes} [Fri Apr 30 13:13:30 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/ips => generated 152 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:13:30.585581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ee9b9b91-e48d-44bf-a86d-d7ca5b64ddbd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741080 Apr 30 13:13:30.586485 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 121/235] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:13:29 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:13:30.859848 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:30.860560 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:30.872282 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:30.872923 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:30.874104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:30.875437 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:31.192003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:31.202777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e3b6fe4a-7619-4f0e-9a82-cb3ef6d39cea tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1515 microversion: 2.1 time: 0.346446 Apr 30 13:13:31.213621 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 115/236] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:30 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:33.141250 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:33.143913 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:33.171747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.174152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:33.177031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.179994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:33.180820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:33.183418 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:33.203127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.205078 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:33.206940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.210956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:33.325749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lazy-loading 'flavor' on Instance uuid b4d095de-4619-4350-a486-c7238d32b916 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:13:33.655058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:33.672979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0f70be00-6c49-4a8d-89cf-52ad6320463c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1515 microversion: 2.1 time: 0.504618 Apr 30 13:13:33.685100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 116/237] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:33 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:33.691686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9af0bd93-0325-4548-9e04-5f61faa13c61"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:33.693135 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:33.712205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.712944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:33.714479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:33.714934 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:34.013268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4af65fdc-2334-4383-b7b8-5b5dff2f3d97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 202 len: 0 microversion: 2.20 time: 0.879673 Apr 30 13:13:34.014337 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 122/238] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:13:33 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:13:34.025084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:34.026342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:34.036911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:34.037677 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:34.039244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:34.039827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:34.332258 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d4e4bb18-9a3f-438d-9fcf-7d66d9e1be23 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645141 Apr 30 13:13:34.338582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 117/239] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:13:33 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:13:34.691806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:34.705969 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:34.708695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:34.710462 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-26fb3941-e6a0-46bc-978c-acc58de87d62 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.690265 Apr 30 13:13:34.722395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 123/240] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:34 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:35.741055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:35.742149 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:35.792414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:35.792883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:35.793746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:35.794188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:36.259196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:36.290761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:36.293564 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:36.295104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3060c1a5-86cd-427a-8252-1025c210f017 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.565674 Apr 30 13:13:36.295904 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 118/241] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:35 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:37.326300 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:37.329104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:37.349047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:37.349732 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:37.350727 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:37.351644 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:37.586718 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:37.595763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:37.597593 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:37.598820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-676783c9-27a0-452b-ac69-ba0cda5e3ef9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.278906 Apr 30 13:13:37.599390 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 124/242] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:37 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:38.620653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:38.621270 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:38.631416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:38.632132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:38.633130 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:38.633783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:38.900858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:38.912147 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:38.914275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:38.915869 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-66fbf989-a81b-41dc-8c58-ceebf19956f0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.299379 Apr 30 13:13:38.917039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 119/243] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:38 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:39.935716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:39.937876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:39.948160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:39.949073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:39.950984 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:39.951706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:40.252517 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:40.267365 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:40.270220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:40.273117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f814f629-1398-45d3-9a0d-3859ca972041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.341500 Apr 30 13:13:40.274493 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 125/244] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:39 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:40.651275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e79bd76f-7b64-4f0c-ae5f-b7107e003e2a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:40.659547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e79bd76f-7b64-4f0c-ae5f-b7107e003e2a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:40.660012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e79bd76f-7b64-4f0c-ae5f-b7107e003e2a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:40.721702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e79bd76f-7b64-4f0c-ae5f-b7107e003e2a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Going to try to stop instance {{(pid=87984) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 30 13:13:40.807413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e79bd76f-7b64-4f0c-ae5f-b7107e003e2a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 202 len: 0 microversion: 2.1 time: 0.159539 Apr 30 13:13:40.808271 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 120/245] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:40 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:13:40.817461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:40.818085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:40.826197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:40.826648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:40.827627 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:40.828070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:41.044180 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:41.054514 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8917ce00-d182-4d7b-b019-1623eff39742 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.241667 Apr 30 13:13:41.055205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 126/246] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:40 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:41.295906 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:41.296605 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:41.305056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:41.305529 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:41.306321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:41.306759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:41.534087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:41.543519 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:41.545020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:41.546186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-73e47dca-4956-48ac-848a-61bfc9b72a78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.254839 Apr 30 13:13:41.546743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 121/247] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:41 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:42.072143 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:42.072748 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:42.081031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:42.081511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:42.082358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:42.082830 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:42.282249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:42.291420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7928df3a-70d0-4589-93d6-298ac1c408b4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.223093 Apr 30 13:13:42.292045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 127/248] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:42 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:42.386106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-255212101", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "d3465f31-0ca2-4ec8-adfb-6ea2134fb5bd"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:42.451418 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] validate_networks() for [('d3465f31-0ca2-4ec8-adfb-6ea2134fb5bd', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:13:42.564322 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:42.564947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:42.574739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:42.575247 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:42.576183 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:42.576720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:42.967955 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:42.977421 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:42.979383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:42.980158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0b74a49a-35a1-40d2-9721-2d560c7f440a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.419684 Apr 30 13:13:42.990750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 128/249] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:42 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:43.060503 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:13:43.061091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:13:43.061587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:13:43.061996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:13:43.062406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:13:43.082675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:43.083136 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:43.083962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:43.084392 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:43.109173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Getting quotas for project cf8e3af25206457fb51bca7a0c237b90. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:13:43.116364 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Getting quotas for user c973e77b8eb14cc497b0fe55f1d5b8ee and project cf8e3af25206457fb51bca7a0c237b90. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:13:43.128944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:13:43.131411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:13:43.179117 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6f818fe3-b7ec-43fe-8a6d-4a1a542fa105 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796706 Apr 30 13:13:43.179809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 122/250] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:13:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:13:43.190035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2a937b23-8ef1-451d-89e0-24d37061e955 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:43.190647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2a937b23-8ef1-451d-89e0-24d37061e955 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:43.274487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2a937b23-8ef1-451d-89e0-24d37061e955 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:43.282657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2a937b23-8ef1-451d-89e0-24d37061e955 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1213 microversion: 2.1 time: 0.096337 Apr 30 13:13:43.283232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 129/251] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:43 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:43.309362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:43.310007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:43.319015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:43.319471 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:43.320251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:43.320687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:43.542355 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:43.553983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6e907fc9-487d-4706-9694-7e04006837fb tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.248648 Apr 30 13:13:43.554673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 123/252] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:43 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:43.998902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:43.999412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:44.007781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.008205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.008990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.009444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.223014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:44.232488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:44.234054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:44.235228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4937c263-ce4c-4ff1-89e3-cdc30f868c17 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.240392 Apr 30 13:13:44.235757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 130/253] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:43 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:44.299841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:44.300599 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:44.308827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.309319 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.310142 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.310597 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.422548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:44.431670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-04bc18ee-b4e9-4d16-a5f9-f4b51e8b6ca0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1217 microversion: 2.1 time: 0.135662 Apr 30 13:13:44.432256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 124/254] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:44 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:44.570794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:44.571320 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:44.579266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.579725 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.580512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:44.580954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:44.856435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:44.865843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4d9e56ac-3f86-4c21-9566-1ccc82030ed0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.299072 Apr 30 13:13:44.866431 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 131/255] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:44 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:45.253658 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:45.254584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:45.263255 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.263882 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:45.264668 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.265230 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:45.449709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:45.451507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:45.461211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.462079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:45.463091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.463884 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:45.487735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:45.497146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:45.498723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:45.499837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-04309bba-b893-466b-ba48-3ac0b387250f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.250071 Apr 30 13:13:45.500558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 125/256] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:45 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:45.585771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:45.594440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-10f9b38b-aa74-4e24-8ac2-adb20058bfaf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1209 microversion: 2.1 time: 0.149332 Apr 30 13:13:45.595020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 132/257] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:45 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:45.884705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:45.885334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:45.893022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.893507 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:45.894292 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:45.894716 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:46.112641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:46.122657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-af26b036-402a-4c8d-8e11-510ef76fa4df tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.243082 Apr 30 13:13:46.123178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 126/258] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:45 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:46.522989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:46.523579 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:46.549007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:46.549489 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:46.550570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:46.551198 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:46.612520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:46.613782 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:46.622653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:46.623124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:46.623955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:46.624395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:46.840220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:46.855575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2e2853ea-dd15-4560-a109-8a304711092a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1271 microversion: 2.1 time: 0.248039 Apr 30 13:13:46.865571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 127/259] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:46 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:46.989543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:46.999755 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:47.001958 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:47.003196 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3df74e51-8f64-4f54-ab3d-4af41272d16d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.488817 Apr 30 13:13:47.003854 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 133/260] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:46 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:47.140238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:47.140850 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:47.148455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:47.149017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:47.149838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:47.150277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:47.547004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:47.558331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-25d82313-0886-40e9-822f-f9a3e6a8eda2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.421910 Apr 30 13:13:47.559467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 128/261] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:47 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:47.873346 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:47.874326 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:47.882743 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:47.883116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:47.884025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:47.884556 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:48.020394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:48.021062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:48.032274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:48.033397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:48.034244 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:48.034874 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:48.193202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:48.203875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-907a0303-be3f-4ae8-b949-df96e709a173 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.334582 Apr 30 13:13:48.204629 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 134/262] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:47 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:48.275990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:48.289670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:48.291178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:48.292330 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-80478475-7c0b-4f41-b320-e67998540fba tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.275767 Apr 30 13:13:48.292883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 129/263] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:48 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:48.576613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:48.577221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:48.585060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:48.585539 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:48.586422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:48.586856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:48.785935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:48.795035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dd282fc2-d1a5-426c-8df7-7f9b91d23c8d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.222317 Apr 30 13:13:48.795651 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 135/264] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:48 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:49.220765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:49.221587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:49.230307 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.230747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:49.231551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.231980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:49.311329 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:49.311970 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:49.320098 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.320527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:49.321358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.321863 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:49.613227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:49.621404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:49.622425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6680bd72-ccae-4da7-b437-3b9f643d5eee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.405442 Apr 30 13:13:49.623141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 130/265] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:49 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:49.630853 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:49.632420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:49.633717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4de29bc4-4cc3-43ff-9d51-13003fa8fc6c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.326140 Apr 30 13:13:49.634256 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 136/266] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:49 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:49.812784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:49.813406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:49.821333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.821804 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:49.822600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:49.823038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:50.026787 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:50.035635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3bcb7b10-86d6-4d00-9755-7b280f8249c1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.226660 Apr 30 13:13:50.036198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 131/267] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:49 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:50.639566 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:50.640326 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:50.649538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:50.649975 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:50.650996 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:50.651444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:50.652216 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:50.652865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:50.661996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:50.662553 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:50.663437 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:50.664054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.234650 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:51.248417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:51.250728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:51.251040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:51.252310 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9f6af527-bb77-4d89-b78c-8ee92cf7b0d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.604490 Apr 30 13:13:51.264637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 132/268] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:50 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:51.269944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:51.270931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:51.279955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:51.280843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.281309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3437b1dc-e141-4574-86cd-b08f8a92f446 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.644182 Apr 30 13:13:51.282145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:51.282836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.285684 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 137/269] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:50 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:51.552693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:51.553763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:51.575245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:51.575699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.576486 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:51.576907 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.648210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'flavor' on Instance uuid 372891ff-ece3-4307-82b1-083d958c298a {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:13:51.790008 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:51.808918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-90ac4afa-959f-4edf-af41-68daebe69f9b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.542711 Apr 30 13:13:51.809815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 133/270] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:51 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:51.814655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-3c6f513f-e218-4abc-a15e-663518449f02 req-36f2d993-a1e9-499c-8313-8595adc697a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f091ca-8d0b-424a-9298-c41c3bd2a1ef", "tag": "8333a690-60e8-4507-822e-695d158ffbc1"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:13:51.816344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:13:51.816344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:13:51.825394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-3c6f513f-e218-4abc-a15e-663518449f02 req-36f2d993-a1e9-499c-8313-8595adc697a7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:51.826176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-3c6f513f-e218-4abc-a15e-663518449f02 req-36f2d993-a1e9-499c-8313-8595adc697a7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:51.845762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-3c6f513f-e218-4abc-a15e-663518449f02 req-36f2d993-a1e9-499c-8313-8595adc697a7 service nova] Creating event network-changed:8333a690-60e8-4507-822e-695d158ffbc1 for instance a3f091ca-8d0b-424a-9298-c41c3bd2a1ef on hv-cinder-78445 Apr 30 13:13:51.851598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-3c6f513f-e218-4abc-a15e-663518449f02 req-36f2d993-a1e9-499c-8313-8595adc697a7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040186 Apr 30 13:13:51.852806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 134/271] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:13:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:13:52.011467 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bf3381d5-111a-4a3e-9507-34df57e50fe3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action" status: 200 len: 32 microversion: 2.1 time: 0.463316 Apr 30 13:13:52.012190 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 138/272] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:13:51 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:13:52.022121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:52.022992 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:52.031812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.032420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.033331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.034036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.274944 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:52.275616 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:52.283974 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.284428 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.285224 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.285692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.436970 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:52.448554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2557f4c4-a729-4ca7-bba0-e9192ef44353 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.430539 Apr 30 13:13:52.449414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 135/273] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:52 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:52.464202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:52.464877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:52.472677 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.473131 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.473967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.474557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.638596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:52.647867 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:52.649600 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:52.650935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b1fb2271-61ef-4090-9843-9285ed24f3b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.382456 Apr 30 13:13:52.651507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 139/274] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:52 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:52.735408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:52.744084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-53946a10-1a27-4824-804e-5c9ae69bea86 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.293472 Apr 30 13:13:52.744864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 136/275] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:52 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:52.827589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:52.828634 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:52.836902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.837549 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:52.838400 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:52.838866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.043782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:53.053911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9f08c9d6-93e7-49bb-8965-d7f19f54b844 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.230493 Apr 30 13:13:53.054491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 140/276] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:52 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:53.467859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:53.469682 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:53.479689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.480444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.481424 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.482301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.668253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:53.668865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:53.677432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.677986 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.678792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.679215 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.689083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:53.701657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7f1c1a56-35b9-4b11-ac61-55ff4fd53bc1 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.239008 Apr 30 13:13:53.702496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 137/277] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:53 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:53.761625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:53.762672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:53.770836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.771375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.772089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:53.772518 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:53.929338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:53.938807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:53.940617 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:53.941972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0e6c687c-4460-4f99-a380-dab1979b5ee1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.277887 Apr 30 13:13:53.942629 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 141/278] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:53 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:54.011966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:54.020602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2cb2c464-92dc-416a-b8e2-ed50d7ef9795 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.262884 Apr 30 13:13:54.021189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 138/279] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:53 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:54.071619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:54.072339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:54.080368 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.080856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:54.081710 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.082147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:54.290265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:54.299254 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5294715f-99ea-4a91-89a0-7a2b933c6aad tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.231558 Apr 30 13:13:54.299814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 142/280] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:54 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:54.724552 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:54.725207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:54.735651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.735879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:54.737740 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.738346 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:54.962355 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:54.963936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:54.974870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.975367 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:54.976545 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:54.977540 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:55.209703 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:55.227375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-277316d0-b632-46ce-bfcb-24b19e4a46a2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.510666 Apr 30 13:13:55.229031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 139/281] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:54 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:55.239206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:55.241036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:55.252280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:55.252845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:55.254359 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:55.255926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:55.654181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:55.666319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:55.668618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:55.670338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a2b2f938-1f81-4382-8f69-06fae496eeb0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.712987 Apr 30 13:13:55.685506 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 143/282] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:54 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:55.691517 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:55.692254 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:55.701220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:55.701884 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:55.702786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:55.703637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:55.827262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:55.854980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5722a033-e2e4-41fa-8b13-02012b636659 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.624092 Apr 30 13:13:55.855968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 140/283] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:55 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:56.008171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:56.023726 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fc4b3590-9adf-496c-9fc3-82e00b881c46 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.336655 Apr 30 13:13:56.034997 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 144/284] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:55 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:56.244731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:56.245315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:56.253625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.254357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.255236 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.255760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.490541 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:56.502027 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-77b77c87-2e6e-422d-9374-669fb3de02c2 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.261511 Apr 30 13:13:56.503493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 141/285] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:56 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:56.691122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:56.691842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:56.700756 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.701358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.702186 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.702637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.874007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:56.874579 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:56.882217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.883058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.884366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:56.885502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:56.952172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:56.962026 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:56.963530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:56.964670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-005bc3f9-a962-4ba0-9789-3817f0a255a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1744 microversion: 2.20 time: 0.277532 Apr 30 13:13:56.965444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 145/286] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:56 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1744 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:57.041145 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:57.042117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:57.050377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.050798 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:57.051791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.052572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:57.122725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:57.143336 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4280f524-4185-4de4-abe1-f7aa84f50b7a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.272820 Apr 30 13:13:57.145105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 142/287] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:56 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:57.271473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:57.283436 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-84025696-146a-4ee7-ba47-4da47bae19d1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.246076 Apr 30 13:13:57.284073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 146/288] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:57 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:57.520731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:57.521653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:57.536413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.542207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:57.545308 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.545802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:57.810824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:57.821953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d9e655fd-4bf8-4459-bc91-fddc8e6efd73 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.305802 Apr 30 13:13:57.822552 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 143/289] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:57 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:13:57.986086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:57.986691 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:57.995475 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.996287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:57.997087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:57.997585 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.162927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:58.163534 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:58.172880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.173694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.174675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.175128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.263052 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:58.274673 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:58.276358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:58.277887 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-71ba970c-a224-4bbe-805a-53a10ce3b1c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1744 microversion: 2.20 time: 0.297364 Apr 30 13:13:58.278572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 147/290] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:57 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1744 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:13:58.300889 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:58.301700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:58.310343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.310836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.311780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.312232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.474485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:58.487798 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e5a6d203-c7a5-4339-af37-04f7aa73f4cd tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.328931 Apr 30 13:13:58.488605 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 144/291] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:58 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:58.590395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:58.600836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3badd141-eb74-443b-8190-193aed2fa3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.304114 Apr 30 13:13:58.612690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 148/292] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:58 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:58.842056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:58.843161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:58.852928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.853611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:58.854548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:58.855089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.102748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:59.113670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3b0ec229-e2b3-4f5f-8068-1f43a4a4394b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.276020 Apr 30 13:13:59.124148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 145/293] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:58 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:13:59.301608 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:59.303985 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:59.315781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.316496 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.317871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.318819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.506302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:59.507171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:59.520628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.521520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.531352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.532096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.885638 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:59.900398 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:59.903871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:13:59.907822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-58d14c45-af2a-48cd-a86b-64a6f121d2af tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.613223 Apr 30 13:13:59.910362 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 149/294] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:13:59 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:59.918415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:59.926296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:13:59.945254 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.949315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:13:59.950675 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:13:59.951262 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:00.000456 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:00.020926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1751e334-bf56-458a-ae89-020c21e6c40a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.519055 Apr 30 13:14:00.026182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 146/295] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:59 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:00.134886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:00.136207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:00.147964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:00.149017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:00.150198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:00.150853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:00.287343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:00.306976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f8063cdd-0a3d-45c1-8a95-cb12160093bc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1724 microversion: 2.1 time: 0.393130 Apr 30 13:14:00.308255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 150/296] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:13:59 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:00.455693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:00.469680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-34b4484d-2504-4bab-a15b-4b6563eae10c tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.341276 Apr 30 13:14:00.479778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 147/297] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:00 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:00.728268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-371937f6-1371-4737-b481-1023e3a8be35 req-d752e949-c52b-4346-bb85-be644234a71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "name": "network-vif-plugged", "status": "completed", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:00.732051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:00.732051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:00.746407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-371937f6-1371-4737-b481-1023e3a8be35 req-d752e949-c52b-4346-bb85-be644234a71c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:00.747310 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-371937f6-1371-4737-b481-1023e3a8be35 req-d752e949-c52b-4346-bb85-be644234a71c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:00.785277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-371937f6-1371-4737-b481-1023e3a8be35 req-d752e949-c52b-4346-bb85-be644234a71c service nova] Creating event network-vif-plugged:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:14:00.791096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-371937f6-1371-4737-b481-1023e3a8be35 req-d752e949-c52b-4346-bb85-be644234a71c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083488 Apr 30 13:14:00.792276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 151/298] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:00.934362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:00.936325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:00.945513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:00.946286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:00.947465 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:00.948099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.046221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:01.047189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:01.066750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.067428 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.068635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.069219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.625855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:01.652048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:01.665615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:01.667150 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7adf2d0e-236d-496f-8c44-fb959c48f579 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.742864 Apr 30 13:14:01.671234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 148/299] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:00 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:01.676294 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:01.689004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:01.705707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.709078 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.712088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.721857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.885461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:01.900641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-72d68571-e54a-4575-96c4-89270e75dcbe tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.859777 Apr 30 13:14:01.901290 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 152/300] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:01 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:01.906598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:01.907526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:01.915634 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.916516 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:01.917620 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:01.918259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:02.165512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:02.181926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-09c74a9f-0845-48a3-b2c8-45f90f39eae6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1701 microversion: 2.1 time: 0.508609 Apr 30 13:14:02.198337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 149/301] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:01 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1701 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:02.209540 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b9c5db57-9374-49a1-8729-a0d7f262764b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:02.219643 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b9c5db57-9374-49a1-8729-a0d7f262764b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:02.220474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b9c5db57-9374-49a1-8729-a0d7f262764b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:02.308897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b9c5db57-9374-49a1-8729-a0d7f262764b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Going to try to start instance {{(pid=87984) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 30 13:14:02.355587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:02.371691 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3a714682-3f4a-4a75-b750-a4b4f3e68cb9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.468804 Apr 30 13:14:02.373554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 153/302] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:01 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:02.463953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b9c5db57-9374-49a1-8729-a0d7f262764b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 202 len: 0 microversion: 2.1 time: 0.259517 Apr 30 13:14:02.466996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 150/303] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:14:02 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:14:02.479611 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:02.480259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:02.498454 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:02.503200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:02.505201 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:02.505953 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:02.695405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:02.698399 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:02.718963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:02.720088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:02.720470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:02.722930 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:03.087810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:03.097816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-17ed0367-6d21-44a5-86b2-863e1efb0123 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1710 microversion: 2.1 time: 0.626760 Apr 30 13:14:03.101967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 154/304] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:02 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1710 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:03.127560 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-86f29595-211a-4669-be0b-50515aa38189 req-fe14e29e-7f65-4ebe-8c73-3c918c6de93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f091ca-8d0b-424a-9298-c41c3bd2a1ef", "name": "network-vif-plugged", "status": "completed", "tag": "8333a690-60e8-4507-822e-695d158ffbc1"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:03.129992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:03.129992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:03.140281 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-86f29595-211a-4669-be0b-50515aa38189 req-fe14e29e-7f65-4ebe-8c73-3c918c6de93f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:03.141298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-86f29595-211a-4669-be0b-50515aa38189 req-fe14e29e-7f65-4ebe-8c73-3c918c6de93f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:03.160822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-86f29595-211a-4669-be0b-50515aa38189 req-fe14e29e-7f65-4ebe-8c73-3c918c6de93f service nova] Creating event network-vif-plugged:8333a690-60e8-4507-822e-695d158ffbc1 for instance a3f091ca-8d0b-424a-9298-c41c3bd2a1ef on hv-cinder-78445 Apr 30 13:14:03.166671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-86f29595-211a-4669-be0b-50515aa38189 req-fe14e29e-7f65-4ebe-8c73-3c918c6de93f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049080 Apr 30 13:14:03.167960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 155/305] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:03.174189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:03.175412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:03.184689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:03.185790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:03.187906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:03.191338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:03.267190 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:03.280859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:03.282768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:03.284188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b2e29d2e-4fb9-4b88-b59d-78d318b4f70f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.593413 Apr 30 13:14:03.298220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 151/306] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:02 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:03.393557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:03.394702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:03.419598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:03.426243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:03.428095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:03.428968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:04.044588 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.054000 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f24be6a-e884-42c6-bf59-53923a375cb3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.884374 Apr 30 13:14:04.054529 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 156/307] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:03 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:04.137476 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:04.146335 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:04.176735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:04.179663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:04.186999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:04.191526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:04.285561 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.301071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b5f94bf5-7f23-465d-95fe-0b494eab18b8 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.915181 Apr 30 13:14:04.303566 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 152/308] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:03 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:04.316365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:04.317316 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:04.333777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:04.334207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:04.335732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:04.336357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:04.808123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.818576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4daa7a5a-4309-4fa2-af49-f5bb23c2496f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1710 microversion: 2.1 time: 0.700008 Apr 30 13:14:04.823244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 157/309] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:04 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1710 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:04.852451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.862813 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.864705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:04.866104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-32ec5c2c-c5a1-482b-a024-916246618f28 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.561308 Apr 30 13:14:04.867338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 153/310] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:04 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:05.074878 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:05.076285 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:05.086776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.087231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.088039 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.088492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.325600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:05.327111 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:05.340685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.341462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.342452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.343085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.402533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:05.410979 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-08dd74e3-9ce7-4704-be47-90abb8308c49 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1313 microversion: 2.1 time: 0.342027 Apr 30 13:14:05.413452 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 158/311] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:05 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:05.769857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:05.787855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-038c9b1d-aec8-46a4-a10e-c6a02f3fe7d3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.466294 Apr 30 13:14:05.799309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 154/312] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:05 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:05.840404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:05.841129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:05.853631 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.854182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.855191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.855728 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.887409 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:05.888085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:05.926114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.927182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:05.928011 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:05.928636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:06.456746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:06.472714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:06.486958 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:06.492939 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e1e15567-e6f4-4624-97d9-1573e8a52cc1 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1710 microversion: 2.1 time: 0.653919 Apr 30 13:14:06.493166 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:06.494253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 159/313] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:05 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1710 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:06.495224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4ba7f716-62f2-487d-b874-6cdab2335d04 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.613062 Apr 30 13:14:06.496254 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 155/314] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:05 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:06.521127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:06.522061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:06.532111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:06.532689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:06.533927 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:06.535913 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:06.800765 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:06.814435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:06.815058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:06.815568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9739ee35-5caa-4782-8ca2-7f36c91aa1e5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1497 microversion: 2.1 time: 0.319983 Apr 30 13:14:06.828478 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 160/315] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:06 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:06.829355 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:06.829857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:06.830684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:06.831117 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:07.214427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:07.230064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f653a614-e36c-49bb-81e7-f8571a8a1131 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.428019 Apr 30 13:14:07.241052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 156/316] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:06 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:07.514933 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:07.519749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:07.520360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:07.522229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:07.543636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:07.543978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:07.544775 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:07.545216 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:07.548127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:07.548583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:07.549448 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:07.549847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:07.993494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.011157 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-052d3e04-8407-4918-be82-15a2c2b4d895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1714 microversion: 2.1 time: 0.499916 Apr 30 13:14:08.023213 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 161/317] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:07 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1714 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:08.028419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:08.029206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:08.037614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.038434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.039756 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.040591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.112024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:14:08.136854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.157082 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.163059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.165350 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-63d7a252-157a-42ae-a3f9-b7f57ba6d81a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.655491 Apr 30 13:14:08.166382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 157/318] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:07 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:08.253486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:08.255151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:08.260414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-326417d5-645c-45c6-929c-b6635644fcee tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 204 len: 0 microversion: 2.1 time: 0.235561 Apr 30 13:14:08.262819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 162/319] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:14:08 2021] DELETE /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:14:08.272604 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:08.273852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:08.280156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.281410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.282665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.283133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.283506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.284084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:08.284528 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.285218 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:08.790111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.808503 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-74f32753-a5ac-448c-af5e-677d97d5bdcf tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1503 microversion: 2.1 time: 0.538431 Apr 30 13:14:08.810241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:08.812307 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 163/320] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:08 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1503 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:08.828105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-23a043d5-88dc-43aa-91a3-e4e7cc244d93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.583466 Apr 30 13:14:08.828672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 158/321] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:08 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:09.212794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:09.214735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:09.228210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.228969 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:09.230337 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.231044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:09.635543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:09.645474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:09.647402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:09.649127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c9d113bc-3c0d-4b80-ba1b-cbb46f70bcac tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.450220 Apr 30 13:14:09.650042 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 164/322] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:09 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:09.830137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:09.831709 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:09.845786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:09.846370 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:09.852828 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.855832 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:09.858104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.860550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.861831 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:09.865195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:09.866924 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:09.868701 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:10.360531 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:10.378314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5ff3011e-0ede-4343-a3a3-62c428b0fcf3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.536121 Apr 30 13:14:10.389252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 165/323] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:09 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:10.404194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:10.423917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c6b00f37-7c3a-498c-ab37-ba62727ab689 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1503 microversion: 2.1 time: 0.597797 Apr 30 13:14:10.423917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 159/324] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:09 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1503 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:10.669988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:10.671085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:10.685128 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:10.685989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:10.687132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:10.687803 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.033015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:11.044214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:11.046202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:11.047511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-220f46de-de6a-46cb-83a4-04e71c289330 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.383017 Apr 30 13:14:11.059305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 166/325] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:10 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:11.321878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-11f0bf2f-ab14-49d1-8d67-3ba40e1f3667 req-634147b0-d2ec-4194-9079-5dcb4e6ae243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f091ca-8d0b-424a-9298-c41c3bd2a1ef", "name": "network-vif-deleted", "tag": "8333a690-60e8-4507-822e-695d158ffbc1"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:11.324502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:11.324502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:14:11.334653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-11f0bf2f-ab14-49d1-8d67-3ba40e1f3667 req-634147b0-d2ec-4194-9079-5dcb4e6ae243 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:11.335115 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-11f0bf2f-ab14-49d1-8d67-3ba40e1f3667 req-634147b0-d2ec-4194-9079-5dcb4e6ae243 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.355909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-11f0bf2f-ab14-49d1-8d67-3ba40e1f3667 req-634147b0-d2ec-4194-9079-5dcb4e6ae243 service nova] Creating event network-vif-deleted:8333a690-60e8-4507-822e-695d158ffbc1 for instance a3f091ca-8d0b-424a-9298-c41c3bd2a1ef on hv-cinder-78445 Apr 30 13:14:11.364661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-11f0bf2f-ab14-49d1-8d67-3ba40e1f3667 req-634147b0-d2ec-4194-9079-5dcb4e6ae243 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046464 Apr 30 13:14:11.366196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 160/326] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:11.397689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:11.398778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:11.432004 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:11.432464 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.433978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:11.434432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.441205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:11.441941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:11.493591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:11.494215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.495728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:11.496174 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:11.652554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:11.665900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-af7cdeb4-d343-43d5-970b-ef1658972473 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 200 len: 1298 microversion: 2.1 time: 0.229141 Apr 30 13:14:11.669442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 161/327] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:11 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:11.895807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:11.907752 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b2b9a63f-d1a1-4574-98a8-3eb80e3a21f3 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1567 microversion: 2.1 time: 0.514655 Apr 30 13:14:11.909132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 167/328] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:11 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1567 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:12.067806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:12.068889 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:12.078455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.079563 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:12.080461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.081053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:12.328714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:12.344643 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:12.352337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:12.356836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3a49c5bb-d3d6-404b-b17b-452a77dfe007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.293386 Apr 30 13:14:12.358325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 162/329] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:12 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:12.692138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:12.694372 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: a3f091ca-8d0b-424a-9298-c41c3bd2a1ef] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:12.708790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.719017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:12.720628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.723117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:12.852838 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] HTTP exception thrown: Instance a3f091ca-8d0b-424a-9298-c41c3bd2a1ef could not be found. Apr 30 13:14:12.853557 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Returning 404 to user: Instance a3f091ca-8d0b-424a-9298-c41c3bd2a1ef could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:14:12.854579 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-66f4e687-b37b-474f-9e25-8f75a7948536 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef" status: 404 len: 111 microversion: 2.1 time: 0.170958 Apr 30 13:14:12.855138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 168/330] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:12 2021] GET /compute/v2.1/servers/a3f091ca-8d0b-424a-9298-c41c3bd2a1ef => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:14:12.925865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:12.926361 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:12.934752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.935014 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:12.935757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:12.936007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.009971 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1631562032", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "d3465f31-0ca2-4ec8-adfb-6ea2134fb5bd"}]}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:13.098413 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] validate_networks() for [('d3465f31-0ca2-4ec8-adfb-6ea2134fb5bd', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:14:13.363803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:13.374109 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ce209b10-cbf7-473e-bc5b-08a7c5161ed4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1547 microversion: 2.1 time: 0.451915 Apr 30 13:14:13.374995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 163/331] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:12 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1547 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:13.392056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:13.393055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:13.402513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.402839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.403935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.404411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.910875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:13.920895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:13.922547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:13.923849 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6936e97b-e5b4-4ee1-8dca-451e51dc7007 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1739 microversion: 2.20 time: 0.536669 Apr 30 13:14:13.924517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 164/332] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:13 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1739 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:13.930016 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:13.930594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:13.931216 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:14:13.931684 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:14:13.932118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:14:13.932530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:14:13.932942 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:14:13.938533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.939075 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.939941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.940446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.941663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.942123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.943004 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:13.943373 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:13.961349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Getting quotas for project cf8e3af25206457fb51bca7a0c237b90. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:14:13.965518 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Getting quotas for user c973e77b8eb14cc497b0fe55f1d5b8ee and project cf8e3af25206457fb51bca7a0c237b90. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:14:13.976992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:14:13.979378 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:14:14.031784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-63b2cd52-fa01-4f96-b9fd-8a1ca0bd46d0 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028487 Apr 30 13:14:14.032637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 169/333] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:14:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:14:14.042488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f119edfe-de81-4d62-8bd9-aadcc216f847 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:14.043106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f119edfe-de81-4d62-8bd9-aadcc216f847 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:14.115053 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f119edfe-de81-4d62-8bd9-aadcc216f847 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:14.130144 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f119edfe-de81-4d62-8bd9-aadcc216f847 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1214 microversion: 2.1 time: 0.091020 Apr 30 13:14:14.131403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 170/334] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:14 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:14.160067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] HTTP exception thrown: Cannot 'detach_volume' instance 372891ff-ece3-4307-82b1-083d958c298a while it is in vm_state rescued Apr 30 13:14:14.160846 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Returning 409 to user: Cannot 'detach_volume' instance 372891ff-ece3-4307-82b1-083d958c298a while it is in vm_state rescued {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:14:14.161729 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-91621529-5036-4956-bf40-67458ca7b0c9 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments/9af0bd93-0325-4548-9e04-5f61faa13c61" status: 409 len: 152 microversion: 2.1 time: 0.236177 Apr 30 13:14:14.162482 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 165/335] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:14:13 2021] DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments/9af0bd93-0325-4548-9e04-5f61faa13c61 => generated 152 bytes in 237 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 13:14:14.170857 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:14.171533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:14.179872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.180331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.181149 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.181617 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.342875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6f2e1809-8842-4553-b951-4ab51c015c1f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action" status: 202 len: 0 microversion: 2.1 time: 0.175427 Apr 30 13:14:14.344020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 171/336] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:14:14 2021] POST /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:14:14.352622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:14.353863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:14.381271 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.382158 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.383803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.384336 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.947340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:14.949479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:14.950001 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:14.962852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.963695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.965630 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:14.966676 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:14.967025 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-538c1d75-b31a-434a-9411-d68251c936ab tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1555 microversion: 2.1 time: 0.618719 Apr 30 13:14:14.976786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 166/337] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:14 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1555 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:15.150251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:15.152306 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:15.161324 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:15.162247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:15.163683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:15.164539 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:15.415167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:15.417127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:15.455678 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4de25e39-b9f5-40b3-ba9f-fe34c7d18013 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1266 microversion: 2.1 time: 0.306750 Apr 30 13:14:15.458020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 167/338] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:15 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:15.467678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:15.470375 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:15.483227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-cb0a4819-b679-422a-97f9-acf956fb8c35 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1721 microversion: 2.20 time: 0.542372 Apr 30 13:14:15.484617 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 172/339] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:14 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1721 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:15.987713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:15.988678 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:16.001386 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.002088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:16.003427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.004157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:16.350560 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:16.362395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-85878977-7609-4a3f-97f9-b63d7bd3a899 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1555 microversion: 2.1 time: 0.380873 Apr 30 13:14:16.372517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 168/340] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:15 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1555 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:16.474473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:16.475097 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:16.482777 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.483745 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:16.484795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.485495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:16.503601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:16.504452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:16.523154 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.527622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:16.528777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:16.529243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:17.024067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:17.034241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:17.035302 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:17.036074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:17.037572 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d2d49b4c-5c0c-4abb-a361-a1d500e319ed tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1721 microversion: 2.20 time: 0.539091 Apr 30 13:14:17.048638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 169/341] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:16 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1721 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:17.052654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6f5384cb-933d-4abb-9a4b-294d4005195a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.581816 Apr 30 13:14:17.057007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 173/342] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:16 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:17.382464 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:17.383096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:17.396417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:17.396917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:17.397858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:17.398607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:17.803382 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-bf7bacfb-938b-440c-921d-8ab9cbe7d683 req-0d5411fa-57cd-4ce0-9c63-8fea227e3d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5", "tag": "beafe99d-0225-4996-9b2c-7e6ed8c092b8"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:17.805779 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:17.805779 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:17.814555 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:17.816616 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bf7bacfb-938b-440c-921d-8ab9cbe7d683 req-0d5411fa-57cd-4ce0-9c63-8fea227e3d53 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:17.817181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bf7bacfb-938b-440c-921d-8ab9cbe7d683 req-0d5411fa-57cd-4ce0-9c63-8fea227e3d53 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:17.825981 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0e15ea3a-942d-45e5-a20d-34b38fd21697 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1555 microversion: 2.1 time: 0.447308 Apr 30 13:14:17.836790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-bf7bacfb-938b-440c-921d-8ab9cbe7d683 req-0d5411fa-57cd-4ce0-9c63-8fea227e3d53 service nova] Creating event network-changed:beafe99d-0225-4996-9b2c-7e6ed8c092b8 for instance 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 on hv-cinder-78445 Apr 30 13:14:17.837800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 170/343] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:17 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1555 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:17.850781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-bf7bacfb-938b-440c-921d-8ab9cbe7d683 req-0d5411fa-57cd-4ce0-9c63-8fea227e3d53 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051800 Apr 30 13:14:17.854165 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 174/344] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:18.056532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:18.057673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:18.065745 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.066524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.067529 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.068162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.071282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:18.071976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:18.080358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.081108 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.082131 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.082955 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.407816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:18.439916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:18.441545 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:18.446408 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:18.449794 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9fc9f568-ccd4-4ec9-865b-16e680fd845a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1724 microversion: 2.20 time: 0.390132 Apr 30 13:14:18.451840 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 171/345] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:18 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:18.456757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-04dfc925-6033-44e6-8dd7-7b6ea8d36bb9 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.388915 Apr 30 13:14:18.457348 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 175/346] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:18 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:18.467817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a21605-7baa-4916-a54c-d3af5ce6766c"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:18.470167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:18.478171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.478978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.480093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.481258 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.784821 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-fcad60c5-8c91-442d-9b1a-65f18260c26c req-b09619b6-5fe5-47ad-974b-e06a0c8fe2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "name": "network-vif-unplugged", "status": "completed", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:18.791814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:18.791814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:18.822732 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fcad60c5-8c91-442d-9b1a-65f18260c26c req-b09619b6-5fe5-47ad-974b-e06a0c8fe2df service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.823707 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fcad60c5-8c91-442d-9b1a-65f18260c26c req-b09619b6-5fe5-47ad-974b-e06a0c8fe2df service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.844605 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.compute.server_external_events [req-fcad60c5-8c91-442d-9b1a-65f18260c26c req-b09619b6-5fe5-47ad-974b-e06a0c8fe2df service nova] Unable to find a host for instance b4d095de-4619-4350-a486-c7238d32b916. Dropping event network-vif-unplugged {{(pid=87983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 30 13:14:18.845609 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-fcad60c5-8c91-442d-9b1a-65f18260c26c req-b09619b6-5fe5-47ad-974b-e06a0c8fe2df service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.075077 Apr 30 13:14:18.846509 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 176/347] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 30 13:14:18.854732 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:18.855450 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:18.863156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.863702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:18.864513 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:18.865096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.124671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:19.142115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0e646218-d76d-4c34-ba09-5b52e69a0efa tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1561 microversion: 2.1 time: 0.294122 Apr 30 13:14:19.143678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 177/348] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:18 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1561 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:19.210806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fe24b676-b138-43d2-82ac-7a086849effa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.746659 Apr 30 13:14:19.216840 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 172/349] 10.222.0.69 () {62 vars in 1364 bytes} [Fri Apr 30 13:14:18 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments => generated 188 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:14:19.277055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:19.277715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:19.286756 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.287172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.288278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.288762 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.365429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:19.366250 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:19.376466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.377311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.378399 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.379063 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.469344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'services' on Instance uuid 372891ff-ece3-4307-82b1-083d958c298a {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:14:19.566728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8bf70263-57a7-4ec4-b48c-2bbd6f37844f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action" status: 202 len: 0 microversion: 2.20 time: 0.204890 Apr 30 13:14:19.567249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 173/350] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:14:19 2021] POST /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:14:19.575339 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:19.576081 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:19.583568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.584097 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.584786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.585217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.639280 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-eecdb589-0b59-46cd-9459-b0c4cc4eb447 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments/9af0bd93-0325-4548-9e04-5f61faa13c61" status: 202 len: 0 microversion: 2.1 time: 0.367596 Apr 30 13:14:19.639883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 178/351] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:14:19 2021] DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a/os-volume_attachments/9af0bd93-0325-4548-9e04-5f61faa13c61 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:14:19.660624 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:19.661769 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:19.672382 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.673083 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.674286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:19.674873 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:19.879403 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:19.889177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-cdfa09e0-cbe3-42b1-8bf4-eccf862f78a4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.317501 Apr 30 13:14:19.890221 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 174/352] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:19 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:19.980009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:19.990197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:19.992402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:19.994632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3f656543-53b8-4273-802f-b417af19f3e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1750 microversion: 2.20 time: 0.353492 Apr 30 13:14:20.006110 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 179/353] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:19 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1750 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:20.906908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:20.907525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:20.915183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:20.915637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:20.916418 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:20.916850 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:21.013842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:21.014605 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:21.022377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:21.022836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:21.023670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:21.024119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:21.171853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:21.186530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-da468b87-741c-4d7b-b843-ec26cb598571 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.283134 Apr 30 13:14:21.187349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 175/354] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:20 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:21.249553 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:21.259773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:21.261260 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:21.262514 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-218ff114-5940-4c14-8b1c-f8c43fcf2c3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1750 microversion: 2.20 time: 0.252643 Apr 30 13:14:21.263139 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 180/355] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:21 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1750 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:22.203470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:22.204080 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:22.212291 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:22.212712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:22.213557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:22.213991 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:22.286120 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:22.286120 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:22.291529 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:22.291976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:22.292782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:22.293177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:22.475900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:22.486826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e036e795-1104-4a85-b6df-fc0755ff2e84 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.286825 Apr 30 13:14:22.488250 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 176/356] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:22 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:22.566921 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:22.576631 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:22.578238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:22.579737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-44a4b65f-5752-41d1-bfe5-23434bc2235a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.301525 Apr 30 13:14:22.580339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 181/357] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:22 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:23.504867 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:23.505699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:23.514594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:23.515068 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:23.515867 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:23.516305 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:23.598744 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:23.599394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:23.607549 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:23.608007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:23.608804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:23.609240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:23.770440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:23.779312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5e5e6eda-e282-4ad9-825b-39b21bb8ef38 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.278216 Apr 30 13:14:23.780233 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 177/358] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:23 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:23.928594 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:23.939007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:23.940515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:23.941729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d18c31fa-af68-4945-a9ac-b66f74a56218 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.347157 Apr 30 13:14:23.942310 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 182/359] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:23 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:24.797068 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:24.797804 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:24.806360 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:24.806805 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:24.807611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:24.808063 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:24.962403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:24.963213 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:24.972663 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:24.974091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:24.974981 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:24.975526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:25.023599 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:25.034722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-204f3b45-5dc6-4bba-9d91-a34d3f908233 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.241138 Apr 30 13:14:25.035806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 178/360] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:24 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:25.192144 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:25.202723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:25.204252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:25.205468 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4cb153e2-e441-493e-8004-ac5236dbfdb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.247150 Apr 30 13:14:25.206054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 183/361] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:24 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:26.052593 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:26.053210 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:26.061212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:26.061731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:26.062505 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:26.062948 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:26.224470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:26.225070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:26.232847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:26.233294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:26.234184 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:26.234615 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:26.270898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:26.281388 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ee1f77c7-c3b0-4ba1-934b-f108843943ec tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.233038 Apr 30 13:14:26.281975 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 179/362] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:26 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:26.443407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:26.452896 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:26.454427 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:26.455572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c51ea6a4-4dd8-4f2d-9f67-0750e37133e2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.234857 Apr 30 13:14:26.456129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 184/363] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:26 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:27.035647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-50a8894b-f580-4c72-8a2d-f4f3b280911c req-1038da43-d109-40e5-8f3d-65b981220e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5", "name": "network-vif-plugged", "status": "completed", "tag": "beafe99d-0225-4996-9b2c-7e6ed8c092b8"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:27.037417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:27.037417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:14:27.047085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-50a8894b-f580-4c72-8a2d-f4f3b280911c req-1038da43-d109-40e5-8f3d-65b981220e5a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:27.047544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-50a8894b-f580-4c72-8a2d-f4f3b280911c req-1038da43-d109-40e5-8f3d-65b981220e5a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:27.066470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-50a8894b-f580-4c72-8a2d-f4f3b280911c req-1038da43-d109-40e5-8f3d-65b981220e5a service nova] Creating event network-vif-plugged:beafe99d-0225-4996-9b2c-7e6ed8c092b8 for instance 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 on hv-cinder-78445 Apr 30 13:14:27.071915 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-50a8894b-f580-4c72-8a2d-f4f3b280911c req-1038da43-d109-40e5-8f3d-65b981220e5a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040679 Apr 30 13:14:27.072757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 180/364] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:27.298957 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:27.299524 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:27.308045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:27.308507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:27.309635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:27.310098 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:27.474455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:27.475634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:27.484297 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:27.485059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:27.486129 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:27.486809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:27.527173 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:27.535805 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-49313f6e-d2df-422d-925d-43cb65f8ea70 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.240578 Apr 30 13:14:27.536384 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 185/365] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:27 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:27.706680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:27.712522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:27.714037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:27.715295 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c73f7f1e-1d88-4a6e-8c54-1fb929e601b8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.244920 Apr 30 13:14:27.715710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 181/366] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:27 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:28.553027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:28.553661 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:28.561158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:28.561792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:28.562572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:28.563085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:28.733530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:28.734980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:28.742569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:28.742987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:28.745285 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:28.746125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:28.766096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:28.774804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e57c9476-fe21-478e-8744-3682a5723a9b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.226054 Apr 30 13:14:28.775392 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 186/367] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:28 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:28.961823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:28.971082 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:28.972588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:28.973749 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f1d6743d-ae60-4e41-a688-5380aeecf044 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.244012 Apr 30 13:14:28.974307 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 182/368] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:28 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:29.792214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:29.792750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:29.800687 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:29.801248 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:29.803292 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:29.803292 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:29.994745 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:29.995543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:30.002900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:30.003394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:30.004181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:30.004615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:30.015194 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:30.024140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-48443f93-73b7-4067-91c9-998135998ffb tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.235771 Apr 30 13:14:30.031723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 187/369] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:29 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:30.206202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:30.215862 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:30.217355 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:30.218570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b75baf36-182d-4631-af72-d777128ebdee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.228100 Apr 30 13:14:30.219268 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 183/370] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:29 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:31.040792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:31.041615 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:31.049800 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:31.050650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:31.052126 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:31.052758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:31.242087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:31.243551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:31.253246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:31.254055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:31.256137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:31.256862 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:31.291150 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:31.300519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8bf2af12-43ed-4529-abd7-be5642336cc4 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1314 microversion: 2.1 time: 0.263700 Apr 30 13:14:31.301116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 188/371] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:31 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:31.489159 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:31.511495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:31.513883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:31.515497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-37a7d256-9cc4-4451-bedb-d5feb4186dee tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.280555 Apr 30 13:14:31.520731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 184/372] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:31 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:32.319343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:32.320040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:32.328740 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:32.329300 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:32.330183 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:32.330612 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:32.534377 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:32.534997 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:32.544096 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:32.553863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:32.554916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:32.555433 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:32.590055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:32.601065 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-71794847-c4b6-4eac-ad55-3deee846bca5 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1499 microversion: 2.1 time: 0.286023 Apr 30 13:14:32.602834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 189/373] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:32 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1499 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:32.856885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:32.866784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:32.868375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:32.869529 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-549a9ce3-1b3c-415c-bee5-6c404d54cd9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.338942 Apr 30 13:14:32.870132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 185/374] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:32 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:33.888641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:33.890296 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:33.895559 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:33.896274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:33.899749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:33.900206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:33.901105 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:33.902054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:33.904898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:33.905495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:33.906481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:33.907047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:33.997250 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:14:34.143441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fcd0732f-f407-440f-a825-2f76e59d592d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 204 len: 0 microversion: 2.1 time: 0.252245 Apr 30 13:14:34.147264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 186/375] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:14:33 2021] DELETE /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:14:34.157672 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:34.158511 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:34.167734 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.168191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.169367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.169752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.403967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:34.420381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:34.422152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:34.423712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4c741516-2895-40df-a7bb-eed7cd4f3b92 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1752 microversion: 2.20 time: 0.539625 Apr 30 13:14:34.424334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 190/376] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:33 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1752 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:34.437540 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:34.449086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:34.464481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.465333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.466256 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.466771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.541741 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:14:34.642741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:34.667604 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d7bb3018-176f-4256-b3ab-1334e4e65f1d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.514845 Apr 30 13:14:34.668982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 187/377] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:34 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:34.689561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-11343373-dfbe-4b1a-a855-0098a6988a37 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "DELETE /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 204 len: 0 microversion: 2.1 time: 0.256132 Apr 30 13:14:34.690160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 191/378] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:14:34 2021] DELETE /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:14:34.698442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:34.699072 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:34.706923 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.707370 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.708349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:34.708797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:34.942210 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:34.951469 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e1c0f5af-f8c6-48c7-8b34-88ef95d30ae7 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.256873 Apr 30 13:14:34.952489 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 188/379] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:34 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:35.447919 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:35.449320 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:35.459424 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.460270 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:35.461387 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.462119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:35.687101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:35.688086 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:35.712675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.714459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:35.716870 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.718223 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:35.848008 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:35.860481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:35.862483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:35.864610 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-179b9bb2-8fb3-4fc4-89b9-6b0ec3e72138 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.423397 Apr 30 13:14:35.865901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 192/380] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:35 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:35.970781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:35.976928 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:35.993836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.994750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:35.996635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:35.999385 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:36.474953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:36.496011 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6d287d1f-0ee4-43cc-85a0-6ef3a856685a tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.813607 Apr 30 13:14:36.508736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 189/381] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:35 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:36.704048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:36.714122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-341ce4f2-aac1-41c7-88b8-6297efb4ad93 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.748216 Apr 30 13:14:36.721434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 193/382] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:35 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:36.893587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:36.894778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:36.903966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:36.904831 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:36.905917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:36.906566 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:37.365161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:37.376846 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:37.378928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:37.380475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1fd8ebad-4afc-4b6a-bbf5-b72ff1cf2747 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.491925 Apr 30 13:14:37.381684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 190/383] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:36 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:37.520698 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:37.522441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:37.535869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:37.537436 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:37.538735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:37.539560 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:37.734697 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:37.736273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:37.760592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:37.761322 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:37.765926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:37.776004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:37.948526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:37.966515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f0650ef6-bf91-4c44-ae9a-d5e733e79409 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.453879 Apr 30 13:14:37.971379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 194/384] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:37 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:38.091088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:38.099716 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-55e927ed-161a-40a7-8f0c-68fbdf90dcdb tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.370696 Apr 30 13:14:38.100689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 191/385] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:37 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:38.412282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:38.413309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:38.441412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:38.441986 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:38.443126 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:38.445023 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:38.987214 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:38.987956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:39.002349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:39.017408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:39.019455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:39.020174 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:39.048647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:39.069301 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:39.071871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:39.073347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2ce11e36-b861-4b2d-b049-d12b0821b638 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.665734 Apr 30 13:14:39.078567 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 195/386] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:38 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:39.118440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:39.119788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:39.137824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:39.138850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:39.139885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:39.150282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:39.637661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:39.655573 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b0f11fef-f50f-497d-a786-4090de40177d tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.671923 Apr 30 13:14:39.656676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 192/387] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:38 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:39.837330 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:39.851622 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f99c93a-5615-4f30-b73c-f787781a7535 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.737049 Apr 30 13:14:39.852930 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 196/388] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:39 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:40.106445 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:40.107068 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:40.115487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.116414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:40.117614 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.118405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:40.604312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:40.615635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:40.620790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:40.625251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d2ea95f6-e9ef-4fbb-805f-94f002da754c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.522802 Apr 30 13:14:40.632062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 193/389] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:40 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:40.688273 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:40.689980 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:40.703877 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.710244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:40.711484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.713154 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:40.869588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:40.870542 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:40.905837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.906278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:40.912229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:40.912847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:41.811297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:41.813812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:41.821758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7178a80c-8a83-4d0a-b64c-f042943b882f tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 1.140070 Apr 30 13:14:41.836242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-feaf1c2b-cb5e-4758-919e-188fbeae3f59 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.964582 Apr 30 13:14:41.838875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 194/390] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:40 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:41.840941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 197/391] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:40 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:41.845226 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:41.846213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:41.856179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:41.856952 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:41.858257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:41.858924 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.352986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:42.365889 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:42.368257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:42.370749 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-90b4d39f-c829-4665-9583-07ddf4c7d461 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.530237 Apr 30 13:14:42.371587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 195/392] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:41 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:42.850160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:42.851525 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:42.858365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:42.859575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:42.867974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.868238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.868471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.869309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.869682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.870571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.871427 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.871995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:43.629961 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:43.640289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-57dce93f-c8c9-464f-bb8b-41fd946ec097 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.787178 Apr 30 13:14:43.650619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 196/393] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:42 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:43.659675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:43.663931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:43.668434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:43.680875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2d5937b9-9574-4889-90e5-a5389c042375 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.837593 Apr 30 13:14:43.682212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:43.682911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:43.684038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:43.686937 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:43.695934 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 198/394] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:42 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:43.702863 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1488091205", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "5afe9a73-d521-4fe7-94d1-3d1ec432eca5"}]}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:43.839347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] validate_networks() for [('5afe9a73-d521-4fe7-94d1-3d1ec432eca5', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:14:44.296007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:44.312228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:44.314015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:44.315301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-84befbd9-9ba6-4c56-b4d7-1cfc611f4c9c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.663317 Apr 30 13:14:44.316206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 197/395] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:43 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:44.660189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:44.660899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:44.675401 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:44.677225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:44.679728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:44.680376 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:44.894098 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:14:44.895582 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:14:44.896581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:14:44.897343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:14:44.898305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:14:44.916587 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:44.917512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:44.918600 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:44.922249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:44.959177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Getting quotas for project 95a5f6800c42410c8d7a418f920d9cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:14:44.964230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Getting quotas for user 36e37e66ad414cbf92ef84bfab15339e and project 95a5f6800c42410c8d7a418f920d9cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:14:44.995202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:14:44.999839 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:14:45.086467 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4a28e968-d290-4f07-bf98-8f3a3c596cd5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389268 Apr 30 13:14:45.088048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 199/396] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:14:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:14:45.093676 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:45.094688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:45.117952 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:45.118137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:45.119203 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:45.119644 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:45.207640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:45.223513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e453b5c3-fcd4-413a-853b-cbff6fddcfc4 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.568537 Apr 30 13:14:45.234938 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 198/397] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:44 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:45.240178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-923a6a5c-7b3d-4548-8b3c-37ccc29a5b9f tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:45.242523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-923a6a5c-7b3d-4548-8b3c-37ccc29a5b9f tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:45.461935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-923a6a5c-7b3d-4548-8b3c-37ccc29a5b9f tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:45.478085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-923a6a5c-7b3d-4548-8b3c-37ccc29a5b9f tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1219 microversion: 2.1 time: 0.239939 Apr 30 13:14:45.479143 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 199/398] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:45 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:45.491935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:45.493020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:45.506844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:45.507776 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:45.508728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:45.509900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:45.824194 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:45.846506 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-88760194-1b08-4879-a50d-4d2dcc518505 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.753024 Apr 30 13:14:45.859772 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 200/399] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:45 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:46.030231 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:46.052513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:46.063089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:46.064733 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-20db3c01-f2ca-4b15-a355-0d3890d0464e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.582298 Apr 30 13:14:46.065481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 200/400] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:45 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:46.242211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:46.242851 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:46.250918 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.251406 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:46.252176 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.252613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:46.495941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:46.496556 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:46.519136 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.520999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:46.522241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.524425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:46.652007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:46.670005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9a89a113-7989-4ab1-b09c-f2b742c09440 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.431591 Apr 30 13:14:46.671222 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 201/401] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:46 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:46.833216 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:46.845870 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b621597d-2ce8-44b1-93fc-6137774f6e3d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1223 microversion: 2.1 time: 0.353789 Apr 30 13:14:46.855615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 201/402] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:46 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1223 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:46.869581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:46.870493 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:46.906944 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.907645 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:46.908829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:46.909456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.086802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:47.087439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:47.120450 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.123197 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.124425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.127351 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.512997 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:47.523335 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ef66df61-58a4-483f-9f78-0463927859ef tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.661410 Apr 30 13:14:47.545612 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 202/403] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:46 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:47.652303 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:47.673886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:47.681065 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:47.694072 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b1531348-0cc1-4295-aad2-741ece5d55e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.611162 Apr 30 13:14:47.702140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:47.702808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 202/404] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:47 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:47.705852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:47.715482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.715933 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.716754 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.717193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.878188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:47.879037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:47.888186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.888944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.890124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:47.890879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:47.942613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:47.956785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3c58fecb-d720-4273-8adf-c450b7fcf409 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.267477 Apr 30 13:14:47.967104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 203/405] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:47 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:48.028128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:48.036491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4b675870-0b3c-426b-928f-5a5b191370ce tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1223 microversion: 2.1 time: 0.162659 Apr 30 13:14:48.037074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 203/406] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:47 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:48.558995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:48.560292 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:48.569156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:48.569883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:48.570829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:48.571466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:48.719983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:48.720742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:48.728533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:48.729199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:48.730144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:48.730816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:49.008308 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.032747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9b275156-c508-4147-90c7-1b6d2c46354c tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1505 microversion: 2.1 time: 0.479051 Apr 30 13:14:49.039352 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 204/407] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:48 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:49.049706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:49.052995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:49.067685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:49.068501 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:49.069534 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:49.070441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:49.160965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.172651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.182352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.184584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6691bb86-d9c2-448d-b6fb-4711a761f19f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.468627 Apr 30 13:14:49.186016 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 204/408] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:48 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:49.192044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:49.194477 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:49.204283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:49.205048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:49.206324 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:49.206980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:49.443849 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.459538 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9fe42a77-9e6e-496d-94e6-10a101540664 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1215 microversion: 2.1 time: 0.270372 Apr 30 13:14:49.464138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 205/409] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:49 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:49.574434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:49.585093 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-845b1cfa-84f5-4a9a-8afb-fdfc0190e51f tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.543060 Apr 30 13:14:49.585926 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 205/410] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:49 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:50.056071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:50.057362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:50.065772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.066554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.073758 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.074497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.205492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:50.206518 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:50.225104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.225593 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.228572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.229406 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.366238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:50.382692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4efb762e-3ca9-4170-b492-0d2593d46ea3 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1463 microversion: 2.1 time: 0.329975 Apr 30 13:14:50.384047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 206/411] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:50 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:50.422623 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-24ac7100-b3a6-4e24-bf80-12e036cc65eb req-161888ee-4fe5-440b-8de3-1fbecaf0c264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5", "name": "network-vif-deleted", "tag": "beafe99d-0225-4996-9b2c-7e6ed8c092b8"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:50.423839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:50.423839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:14:50.440148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-24ac7100-b3a6-4e24-bf80-12e036cc65eb req-161888ee-4fe5-440b-8de3-1fbecaf0c264 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.440581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-24ac7100-b3a6-4e24-bf80-12e036cc65eb req-161888ee-4fe5-440b-8de3-1fbecaf0c264 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.485805 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-24ac7100-b3a6-4e24-bf80-12e036cc65eb req-161888ee-4fe5-440b-8de3-1fbecaf0c264 service nova] Creating event network-vif-deleted:beafe99d-0225-4996-9b2c-7e6ed8c092b8 for instance 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 on hv-cinder-78445 Apr 30 13:14:50.494446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-24ac7100-b3a6-4e24-bf80-12e036cc65eb req-161888ee-4fe5-440b-8de3-1fbecaf0c264 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075805 Apr 30 13:14:50.498175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 207/412] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:50.505796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:50.506667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:50.516312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.516901 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.518134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.518693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.672900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:50.683676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0ebcf479-0808-4e5a-a8a9-59810b5ee2af tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1279 microversion: 2.1 time: 0.184121 Apr 30 13:14:50.691868 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 208/413] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:50 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:50.708686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:50.709617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:50.731224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.731224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.732262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:50.732800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:50.800746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:50.827415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:50.832242 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:50.833512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d55c548a-f9f5-472b-9841-a4baac2a9eb9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.633335 Apr 30 13:14:50.834100 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 206/414] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:50 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:51.399372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:51.414631 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:51.415298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:51.422968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bad05c21-e50a-42fa-aa01-d907b4a0cd7b tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 0.729547 Apr 30 13:14:51.428707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 209/415] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:50 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:51.430205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.430662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.434441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.435182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.605556 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.606013 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.606521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lazy-loading 'fault' on Instance uuid 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:14:51.689349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c973e77b8eb14cc497b0fe55f1d5b8ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8e3af25206457fb51bca7a0c237b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:51.703604 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-17bbbffd-d7b9-4771-b664-01fc9c48919b tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 200 len: 1304 microversion: 2.1 time: 0.288322 Apr 30 13:14:51.704753 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 207/416] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:51 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 1304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:51.722287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:51.722905 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:51.755118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.755863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.757034 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.757771 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.854790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:51.855985 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:51.871584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.872346 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:51.873914 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:51.874665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:52.648566 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:52.662585 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e470540d-89d3-4fc4-9cb1-1ffe4751bb5d tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.944682 Apr 30 13:14:52.664535 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 210/417] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:51 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:52.675852 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:52.677114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:52.692880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:52.693356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:52.694420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:52.695173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:53.396785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:53.415757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:53.424983 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:53.427048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-de5bd325-cd5e-46dc-a081-33b1bfaf5b0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 1.578606 Apr 30 13:14:53.438276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 208/418] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:51 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:53.458501 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:53.459334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] [instance: 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:53.471819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:53.472482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:53.477118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:53.477788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:53.603623 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] HTTP exception thrown: Instance 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 could not be found. Apr 30 13:14:53.604257 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] Returning 404 to user: Instance 4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:14:53.605102 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dc127d02-4b6a-4720-894d-f1b2b04f3160 tempest-VolumesActionsTest-389229486 tempest-VolumesActionsTest-389229486-project] 10.222.0.69 "GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5" status: 404 len: 111 microversion: 2.1 time: 0.165422 Apr 30 13:14:53.605727 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 209/419] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:53 2021] GET /compute/v2.1/servers/4249fd9b-31ea-48b6-8b78-ef2cbbf8d2b5 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:14:53.622089 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-111dc7b8-171f-4389-9781-f636388fc018 req-12c5555b-e477-4fc7-9b87-60b902364ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7f5373-9990-486e-b303-1e46fc75e956", "tag": "e679c56c-ca0d-455a-aea9-2cf760a03f8d"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:53.625265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:53.625265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:53.649434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-111dc7b8-171f-4389-9781-f636388fc018 req-12c5555b-e477-4fc7-9b87-60b902364ce9 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:53.650118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-111dc7b8-171f-4389-9781-f636388fc018 req-12c5555b-e477-4fc7-9b87-60b902364ce9 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:53.681675 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-111dc7b8-171f-4389-9781-f636388fc018 req-12c5555b-e477-4fc7-9b87-60b902364ce9 service nova] Creating event network-changed:e679c56c-ca0d-455a-aea9-2cf760a03f8d for instance bc7f5373-9990-486e-b303-1e46fc75e956 on hv-cinder-78445 Apr 30 13:14:53.687246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-111dc7b8-171f-4389-9781-f636388fc018 req-12c5555b-e477-4fc7-9b87-60b902364ce9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068598 Apr 30 13:14:53.688715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 210/420] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:53.697941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:53.699264 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:53.712810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:53.714784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:53.715857 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:53.719054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:54.111458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:54.122833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-92ab5780-d949-432a-8dbd-d295476608f5 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1508 microversion: 2.1 time: 1.456730 Apr 30 13:14:54.123537 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 211/421] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:52 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1508 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:54.448038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:54.448944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:54.461200 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:54.461974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:54.471189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:54.471815 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:54.641720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:54.651559 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-eacd678a-1cb0-4a30-9f55-a023b32deac5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.957980 Apr 30 13:14:54.652163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 211/422] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:53 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:54.657338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-a78790f3-7e2c-484d-ae62-8f4054ec8b3d req-948d9800-0a50-4493-975d-9e5332a43159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ecc5adf-4994-4a01-b659-44bb30c5af63", "name": "network-vif-deleted", "tag": "308cbf45-0e9c-4a51-baf7-d8508b14282f"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:54.659175 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:54.659175 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:14:54.669469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-a78790f3-7e2c-484d-ae62-8f4054ec8b3d req-948d9800-0a50-4493-975d-9e5332a43159 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:54.670137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-a78790f3-7e2c-484d-ae62-8f4054ec8b3d req-948d9800-0a50-4493-975d-9e5332a43159 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:54.688431 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-a78790f3-7e2c-484d-ae62-8f4054ec8b3d req-948d9800-0a50-4493-975d-9e5332a43159 service nova] Creating event network-vif-deleted:308cbf45-0e9c-4a51-baf7-d8508b14282f for instance 7ecc5adf-4994-4a01-b659-44bb30c5af63 on hv-cinder-78445 Apr 30 13:14:54.695147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-a78790f3-7e2c-484d-ae62-8f4054ec8b3d req-948d9800-0a50-4493-975d-9e5332a43159 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040378 Apr 30 13:14:54.697697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 212/423] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:55.110812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:55.126232 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:55.128264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:55.130293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-07ceb49c-1924-455f-9201-8f472a1db596 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.686096 Apr 30 13:14:55.132578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 212/424] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:54 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:55.143075 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:55.144140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:55.158592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.159045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.159855 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.161231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.257829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.258317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.258903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'fault' on Instance uuid 7ecc5adf-4994-4a01-b659-44bb30c5af63 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:14:55.625105 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:55.634482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5beacb7e-6cb7-45c7-9b23-68afb7b142cf tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 200 len: 1312 microversion: 2.1 time: 0.496576 Apr 30 13:14:55.638340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 213/425] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:55 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 1312 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:55.668802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:55.669338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:55.684859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.685311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.686132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.686736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.149287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:56.150604 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:56.158324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.158774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.159549 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.160002 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.202278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:56.219378 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4d2f47ec-e8c6-4b20-85bf-6bd9db09d8c6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.554014 Apr 30 13:14:56.228918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 213/426] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:55 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:56.559059 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:56.569999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:56.570949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:56.572113 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-43dd15c4-bf12-499a-bd36-8cd58e245ea2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.426849 Apr 30 13:14:56.572657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 214/427] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:56 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:56.654809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:56.655428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 7ecc5adf-4994-4a01-b659-44bb30c5af63] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:56.663470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.663974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.664817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.665356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.720271 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] HTTP exception thrown: Instance 7ecc5adf-4994-4a01-b659-44bb30c5af63 could not be found. Apr 30 13:14:56.720897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Returning 404 to user: Instance 7ecc5adf-4994-4a01-b659-44bb30c5af63 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:14:56.721759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-50bd6440-a420-444e-8182-381292f4f818 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63" status: 404 len: 111 microversion: 2.1 time: 0.070815 Apr 30 13:14:56.722510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 214/428] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:56 2021] GET /compute/v2.1/servers/7ecc5adf-4994-4a01-b659-44bb30c5af63 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:14:56.731323 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:56.731958 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:56.740910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.741152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.742470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:56.743132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:56.821957 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:14:56.990127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6a9f7105-d69f-4b7d-a8d1-42a1db3939dd tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 204 len: 0 microversion: 2.1 time: 0.262333 Apr 30 13:14:56.994488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 215/429] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:14:56 2021] DELETE /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:14:56.999531 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:57.000446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:57.008978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.009766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.010760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.011202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.237185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:57.238059 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:57.246807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.247245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.248262 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.248932 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.430008 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:57.443133 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4cf4925a-b28a-4f4e-b805-b4f77c5b4f72 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.446630 Apr 30 13:14:57.454205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 215/430] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:56 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:57.592008 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:57.592932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:57.601748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.602508 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.603455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.604003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.628861 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:57.637594 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4155bb4f-0688-447c-91de-7ac3fb7d3de1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.404999 Apr 30 13:14:57.641206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 216/431] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:57 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:58.067721 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:58.083476 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:58.085939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:58.087999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-abef366c-caf1-4bd6-8f06-c1f47b0fff69 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.501047 Apr 30 13:14:58.089246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 216/432] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:57 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:58.466118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:58.470598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:58.484885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:58.486117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:58.487715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:58.488670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:58.658192 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:58.659504 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:58.679246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:58.680394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:58.681740 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:58.682470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:59.058613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:59.070344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e1369e27-2485-448b-a253-e11bb6ef962d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.611754 Apr 30 13:14:59.079950 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 217/433] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:58 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:14:59.113434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:59.114647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:59.123568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:59.124285 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:59.125318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:59.125926 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:59.173762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:59.183879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-05259471-ad79-4117-8f51-3e44e0ba68cd tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.530769 Apr 30 13:14:59.185610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 217/434] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:14:58 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:14:59.364962 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:59.379518 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:59.381699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:14:59.383132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8602f895-ae71-4800-870b-67ba07fa5701 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.273744 Apr 30 13:14:59.383797 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 218/435] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:14:59 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:14:59.501221 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Action: 'create', calling method: .version_select at 0x7fe2fae0d820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1313915457"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:14:59.525217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:14:59.530148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for user 5c88c75fe03843c9ad120269832bc227 and project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:14:59.544473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [735aa798-4f65-4c29-b520-9148d68653a6] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:14:59.935336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:59.936016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:14:59.943477 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:59.943930 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:59.944827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:59.945212 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.142762 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lazy-loading 'services' on Instance uuid 9504e6a6-a9cf-4f1a-a169-eea54daf121c {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:15:00.302161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-98c1ac6e-23cf-47b4-b929-59be051adef4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-volume_attachments/2c207bd4-e802-4a0d-837b-4a2e79adf31d" status: 202 len: 0 microversion: 2.1 time: 0.370375 Apr 30 13:15:00.306183 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 219/436] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:14:59 2021] DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/os-volume_attachments/2c207bd4-e802-4a0d-837b-4a2e79adf31d => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:15:00.317952 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:00.318726 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:00.329743 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.330379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.331278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.331725 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.573520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [735aa798-4f65-4c29-b520-9148d68653a6] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 51088. Apr 30 13:15:00.694118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:00.705300 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1b087195-4020-48d1-9757-d5a7e5924be0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.397799 Apr 30 13:15:00.714409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 220/437] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:00 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:00.726721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:00.727387 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:00.745277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.745802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.746665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.747164 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.876087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:15:00.881939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for user 5c88c75fe03843c9ad120269832bc227 and project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:15:00.923846 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bf91207c-5541-4f00-a894-9bd87930fe4f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.682090 Apr 30 13:15:00.930099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 218/438] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Apr 30 13:14:59 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:00.940209 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:00.940646 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:00.984477 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.984993 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:00.988973 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:00.990117 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:01.221530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:01.234628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-19b3ac66-0f8c-4be6-b113-462d30248f84 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.516816 Apr 30 13:15:01.237047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 221/439] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:00 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:01.364500 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:01.376597 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:01.378558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:01.380077 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d2198789-29b5-4a34-bccf-5ed46827bf3b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.453068 Apr 30 13:15:01.391544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 219/440] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:00 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:01.731281 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:01.732276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:01.750452 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:01.762044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:01.765869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:01.766583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:01.776439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-15209e88-ac66-49ff-b92f-1f6affdc8376 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:01.798229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15209e88-ac66-49ff-b92f-1f6affdc8376 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:01.801689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15209e88-ac66-49ff-b92f-1f6affdc8376 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:01.898349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-15209e88-ac66-49ff-b92f-1f6affdc8376 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Going to try to stop instance {{(pid=87984) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 30 13:15:02.015165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-15209e88-ac66-49ff-b92f-1f6affdc8376 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 202 len: 0 microversion: 2.1 time: 0.244062 Apr 30 13:15:02.016129 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 220/441] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:15:01 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:15:02.045192 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:02.046272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:02.056914 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.057775 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.058634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.059902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.318430 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:02.330387 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ec51c67b-9e30-4e1f-a1c0-d61be6d97cee tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.603714 Apr 30 13:15:02.341895 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 222/442] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:01 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:02.346871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:02.347746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:02.355725 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.356417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.357421 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.358011 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.599710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:02.613341 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d769bff5-c7d5-4a17-a461-e17b4336c55f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.592466 Apr 30 13:15:02.625290 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 221/443] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:02 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:02.633130 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:02.633792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:02.663952 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.664430 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.665277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:02.665802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:02.785979 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:02.794932 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-25823902-b088-470f-a61e-772066ae5b82 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.451641 Apr 30 13:15:02.807444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 223/444] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:02 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:03.053226 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:03.065269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:03.066981 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:03.068296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-55473d7b-3335-4158-b14d-d2055c949f66 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.441863 Apr 30 13:15:03.079445 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 222/445] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:02 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:03.348850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:03.350282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:03.358811 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.359276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:03.360087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.360523 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:03.632408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:03.643191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:03.658458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.659496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:03.660576 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.661228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:03.739834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:03.761199 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e09a8ccf-518c-41df-ac4a-e46dbe580833 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.414577 Apr 30 13:15:03.761901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 224/446] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:03 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:03.812430 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:03.813054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:03.821407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.822125 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:03.823171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:03.823760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.167636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:04.178428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0399aa80-4169-45ee-b5f7-863e6b6fd247 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.551165 Apr 30 13:15:04.183456 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 223/447] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:03 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:04.191072 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:04.191978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:04.219788 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:04.222279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.230592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:04.231318 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.453494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:04.463453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-270a92cb-5089-45a5-baa7-0ae3a9c5585c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.655024 Apr 30 13:15:04.474971 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 225/448] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:03 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:04.494374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-7182de96-3b00-4c19-9b30-d843de492f0e req-9b54a0dc-77d3-4130-8459-0ce46353e9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7f5373-9990-486e-b303-1e46fc75e956", "name": "network-vif-plugged", "status": "completed", "tag": "e679c56c-ca0d-455a-aea9-2cf760a03f8d"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:04.496823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:15:04.496823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:15:04.525672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7182de96-3b00-4c19-9b30-d843de492f0e req-9b54a0dc-77d3-4130-8459-0ce46353e9de service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:04.526665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7182de96-3b00-4c19-9b30-d843de492f0e req-9b54a0dc-77d3-4130-8459-0ce46353e9de service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.580812 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-7182de96-3b00-4c19-9b30-d843de492f0e req-9b54a0dc-77d3-4130-8459-0ce46353e9de service nova] Creating event network-vif-plugged:e679c56c-ca0d-455a-aea9-2cf760a03f8d for instance bc7f5373-9990-486e-b303-1e46fc75e956 on hv-cinder-78445 Apr 30 13:15:04.684583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-7182de96-3b00-4c19-9b30-d843de492f0e req-9b54a0dc-77d3-4130-8459-0ce46353e9de service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204217 Apr 30 13:15:04.686218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 226/449] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:04.818496 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:04.819340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:04.845565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:04.846061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.846904 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:04.847349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:04.941864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:04.967830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:04.973713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:04.983586 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-25d48646-5842-4482-bde0-79da6180518f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.796034 Apr 30 13:15:04.988997 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 224/450] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:04 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:05.200182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:05.200886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:05.235521 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:05.239248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:05.240883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:05.245971 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:05.342820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:05.356453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b64a8e43-3027-4f19-acdf-09ad15603bfe tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1521 microversion: 2.1 time: 0.567802 Apr 30 13:15:05.360772 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 227/451] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:04 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:05.482402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:05.483327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:05.504568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:05.514025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:05.515064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:05.519425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:05.954962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:05.980052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-95fccebb-99cf-4dda-87a7-0bdb4f128a41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.781432 Apr 30 13:15:05.983120 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 225/452] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:05 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:06.008319 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:06.009343 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:06.030493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.031397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.032939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.033722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.127721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:06.139351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-132b27a0-50fe-40f3-80e5-43ec7309614e tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1319 microversion: 2.1 time: 0.660748 Apr 30 13:15:06.145403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 228/453] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:05 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:06.321671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:06.333476 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:06.335546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:06.337026 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e2b156f0-1059-4b11-a4c7-b633dfce5248 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.332861 Apr 30 13:15:06.348635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 226/454] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:06 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:15:06.379149 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:06.380165 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:06.390152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.391011 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.391860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.392359 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.567443 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:06.598053 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7c3a6955-fa53-4b1c-a38b-65ef0b7888b0 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1479 microversion: 2.1 time: 0.222929 Apr 30 13:15:06.620771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 229/455] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:06 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1479 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:06.720336 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-df237a5c-e6b1-4241-9b6b-7982d6b0f94e req-752370ef-897d-4d24-a880-b5c9ca4b22cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372891ff-ece3-4307-82b1-083d958c298a", "name": "network-vif-deleted", "tag": "d7b2af60-4552-417a-9aa9-646dcfac8e70"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:06.737311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:15:06.737311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:15:06.761050 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-df237a5c-e6b1-4241-9b6b-7982d6b0f94e req-752370ef-897d-4d24-a880-b5c9ca4b22cf service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.761690 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-df237a5c-e6b1-4241-9b6b-7982d6b0f94e req-752370ef-897d-4d24-a880-b5c9ca4b22cf service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.766506 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-be446978-46db-4a61-860e-5855927cf8f3 req-989946e1-33e8-4637-b00d-39752758aec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "name": "network-vif-plugged", "status": "completed", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:06.768090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:15:06.768090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:15:06.784193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-df237a5c-e6b1-4241-9b6b-7982d6b0f94e req-752370ef-897d-4d24-a880-b5c9ca4b22cf service nova] Creating event network-vif-deleted:d7b2af60-4552-417a-9aa9-646dcfac8e70 for instance 372891ff-ece3-4307-82b1-083d958c298a on hv-cinder-78445 Apr 30 13:15:06.785575 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-be446978-46db-4a61-860e-5855927cf8f3 req-989946e1-33e8-4637-b00d-39752758aec4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:06.786032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-be446978-46db-4a61-860e-5855927cf8f3 req-989946e1-33e8-4637-b00d-39752758aec4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:06.791598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-df237a5c-e6b1-4241-9b6b-7982d6b0f94e req-752370ef-897d-4d24-a880-b5c9ca4b22cf service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088265 Apr 30 13:15:06.794707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 227/456] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:15:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:06.807158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-be446978-46db-4a61-860e-5855927cf8f3 req-989946e1-33e8-4637-b00d-39752758aec4 service nova] Creating event network-vif-plugged:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:15:06.814183 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-be446978-46db-4a61-860e-5855927cf8f3 req-989946e1-33e8-4637-b00d-39752758aec4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051152 Apr 30 13:15:06.815233 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 230/457] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:15:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:07.008982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:07.010137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:07.029896 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.030694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.031967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.032606 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.169055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:07.170238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:07.187318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.188164 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.189048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.189515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.417726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:07.434025 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-74e99879-251e-4ca3-8d76-affec7500d41 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.437251 Apr 30 13:15:07.445217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 228/458] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:06 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:07.451304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:07.452675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:07.462314 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.463132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.464199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.464989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.733444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:07.756774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c3778257-b09f-4f58-b778-a4bcb26236c9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1508 microversion: 2.1 time: 0.591462 Apr 30 13:15:07.758323 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 231/459] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:07 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:07.766510 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:07.767815 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:07.787307 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.789206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.791327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.792533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.886343 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:07.904868 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:07.910051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:07.914460 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f108f9e5-d89a-48e2-aec5-2eba180cdcdd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.467446 Apr 30 13:15:07.934934 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:07.935366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 229/460] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:07 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:07.936270 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:07.936795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lazy-loading 'fault' on Instance uuid 372891ff-ece3-4307-82b1-083d958c298a {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:15:08.016864 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce34344206a94c50b0174dd726bf8e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae82ace87d14c12b35259bd0973dda6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:08.026578 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6bffd2cc-46ee-4965-b5b1-aa1b33151e6d tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 200 len: 1311 microversion: 2.1 time: 0.265520 Apr 30 13:15:08.027192 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 232/461] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:07 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 1311 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:08.452503 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:08.454166 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:08.463395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:08.464486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:08.465680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:08.466527 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:08.779955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:08.789694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8ab59064-43dc-4c6c-947a-09ea975995c3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.341105 Apr 30 13:15:08.790297 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 230/462] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:08 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:08.943887 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:08.944704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:08.958321 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:08.958825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:08.960259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:08.960757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:09.045440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:09.046458 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] [instance: 372891ff-ece3-4307-82b1-083d958c298a] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:09.056548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:09.057451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:09.057914 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:09.058353 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:09.117029 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] HTTP exception thrown: Instance 372891ff-ece3-4307-82b1-083d958c298a could not be found. Apr 30 13:15:09.117786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] Returning 404 to user: Instance 372891ff-ece3-4307-82b1-083d958c298a could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:09.118763 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e09edd54-cb85-4809-93bb-d808d16fed32 tempest-ServerRescueNegativeTestJSON-1718798279 tempest-ServerRescueNegativeTestJSON-1718798279-project] 10.222.0.69 "GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a" status: 404 len: 111 microversion: 2.1 time: 0.077770 Apr 30 13:15:09.135189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 231/463] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:09 2021] GET /compute/v2.1/servers/372891ff-ece3-4307-82b1-083d958c298a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:15:09.254693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:09.271399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:09.273650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:09.275268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-16aafd98-a556-4452-b484-1aa8e97b4dfa tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.337623 Apr 30 13:15:09.276070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 233/464] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:08 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:09.807851 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:09.808627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:09.817242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:09.817665 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:09.818654 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:09.819134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:10.116150 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:10.132350 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e8f41752-881a-471b-a42f-d2ea240ef83b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.328195 Apr 30 13:15:10.133504 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 232/465] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:09 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:10.294303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:10.295804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:10.310977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:10.311842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:10.312750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:10.313218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:10.701531 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:10.713049 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:10.715504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:10.717119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-63f6062b-0eb6-4160-b2bb-4c93fb1a6378 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.426789 Apr 30 13:15:10.732009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 234/466] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:10 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:11.162710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:11.163306 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:11.171447 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:11.172113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:11.172927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:11.173438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:11.692954 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:11.705040 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dc9e525f-bf9d-436b-bbc0-adf09520c664 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1678 microversion: 2.1 time: 0.546443 Apr 30 13:15:11.723180 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 233/467] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:11 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1678 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:11.740618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:11.741465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:11.757604 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:11.758323 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:11.760191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:11.760773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:12.086964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:12.104926 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:12.107377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:12.109411 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-90e2cfc1-7035-4fde-ace0-183a89297724 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.373569 Apr 30 13:15:12.122258 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 235/468] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:11 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:12.722992 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:12.723628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:12.731656 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:12.732132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:12.732952 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:12.733410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.043024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:13.062406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-43c3b261-15fc-473d-91ba-ffa72c92418f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1655 microversion: 2.1 time: 0.342855 Apr 30 13:15:13.062727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 234/469] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:12 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1655 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:13.083157 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d35ae00b-d040-4a4d-9500-def8ad0e7653 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:13.096101 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d35ae00b-d040-4a4d-9500-def8ad0e7653 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:13.101208 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d35ae00b-d040-4a4d-9500-def8ad0e7653 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.128441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:13.129640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:13.148095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:13.148918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.164171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:13.166008 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.345928 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d35ae00b-d040-4a4d-9500-def8ad0e7653 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Going to try to start instance {{(pid=87983) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 30 13:15:13.571303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d35ae00b-d040-4a4d-9500-def8ad0e7653 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action" status: 202 len: 0 microversion: 2.1 time: 0.491825 Apr 30 13:15:13.576340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 236/470] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:15:13 2021] POST /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:15:13.584214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:13.584920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:13.608190 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:13.608788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.609550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:13.610034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:13.815391 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:13.827752 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:13.832114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:13.834638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2f048023-a050-431a-93d7-2772be922986 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.710179 Apr 30 13:15:13.848980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 235/471] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:13 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:15:13.964972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:13.983817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f0d6c83-2686-4085-907a-9b3ed4cee895 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1664 microversion: 2.1 time: 0.405895 Apr 30 13:15:13.984719 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 237/472] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:13 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1664 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:14.856358 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:14.857905 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:14.870974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:14.872048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:14.873448 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:14.874199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:15.003017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:15.004499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:15.015758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:15.017440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:15.019096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:15.019771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:15.365443 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:15.395588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:15.398745 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:15.402133 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6e8b628b-d9c7-47c3-94cf-01509b08bed8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.550584 Apr 30 13:15:15.403437 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 236/473] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:14 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:15.653597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:15.663870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2db287b5-1170-4e28-8b4c-073fe9f16427 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1664 microversion: 2.1 time: 0.665257 Apr 30 13:15:15.665118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 238/474] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:14 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1664 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:16.424227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:16.425705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:16.446088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:16.449348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:16.451735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:16.454252 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:16.683432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:16.684796 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:16.694001 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:16.694992 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:16.696060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:16.696707 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:17.207809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:17.235036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:17.238781 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:17.241762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3a77989e-4448-4c8d-9d41-e66f9f35be74 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.821095 Apr 30 13:15:17.245428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 237/475] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:16 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:17.296936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:17.306621 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-68d45ad6-a511-4892-9163-db2a023b0a6b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1664 microversion: 2.1 time: 0.627431 Apr 30 13:15:17.316721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 239/476] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:16 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1664 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:18.264732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:18.264732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:18.289838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:18.295351 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:18.296337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:18.297002 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:18.328685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:18.329730 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:18.355941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:18.356643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:18.366929 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:18.367871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:18.752084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:18.754511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:18.767134 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e6dcd2cb-541e-4d0e-8251-cd9fbd177797 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1668 microversion: 2.1 time: 0.445640 Apr 30 13:15:18.779541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 240/477] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:18 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1668 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:18.789427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:18.791467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:18.793146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ebfaba92-1d97-4c09-a40c-0256fecc3b48 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.533831 Apr 30 13:15:18.795237 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 238/478] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:18 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:19.822819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:19.824242 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:19.833602 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:19.834487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:19.835639 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:19.836333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:20.148071 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:20.164775 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:20.167308 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:20.168917 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0686ea80-6661-4962-bddb-dd0565b0e367 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.350557 Apr 30 13:15:20.170139 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 241/479] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:19 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:20.710408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d9e41eef-429b-4dac-92ad-43c364fea59a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Action: 'create', calling method: .version_select at 0x7fe2facb6af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-502650312"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:21.201828 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:21.203079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:21.227126 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:21.228948 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:21.238294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:21.239223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:21.389898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d9e41eef-429b-4dac-92ad-43c364fea59a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.988309 Apr 30 13:15:21.391509 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 239/480] 10.222.0.69 () {60 vars in 1155 bytes} [Fri Apr 30 13:15:20 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 991 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 13:15:21.420074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1745a87c-c0a0-4be3-af60-867c7d9b85c5 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fc7d4550>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:21.677605 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:21.687717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:21.691067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1745a87c-c0a0-4be3-af60-867c7d9b85c5 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 200 len: 344 microversion: 2.1 time: 0.284087 Apr 30 13:15:21.692116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 240/481] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:21 2021] GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 344 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:21.698491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:21.700035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1bdbae59-821c-42f5-b4bc-136d3b047835 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.506967 Apr 30 13:15:21.707106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 242/482] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:21 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:22.704699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-657375fc-bd9f-402f-a2ec-1fd165921cfa tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb68ae50>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:22.729160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:22.733300 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:22.741533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:22.742484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:22.743540 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:22.744143 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:22.868862 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-657375fc-bd9f-402f-a2ec-1fd165921cfa tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 200 len: 345 microversion: 2.1 time: 0.168190 Apr 30 13:15:22.869886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 241/483] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:22 2021] GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:22.891756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7ca2cdff-eba3-4e0a-85cd-cca60f4ae3a2 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Action: 'create', calling method: .version_select at 0x7fe2fadd3430>, body: {"snapshot": {"volume_id": "3bd7b969-fdf9-44e1-8166-f985d5793c43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1060288774"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:23.123543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:23.161862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:23.164790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:23.170202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f9f476ab-e528-43e8-99cf-482043f37ae9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.447207 Apr 30 13:15:23.171974 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 243/484] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:22 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:23.264974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7ca2cdff-eba3-4e0a-85cd-cca60f4ae3a2 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.385907 Apr 30 13:15:23.266480 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 242/485] 10.222.0.69 () {60 vars in 1162 bytes} [Fri Apr 30 13:15:22 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:23.278118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fbaf7212-4db8-425a-bd9f-aac12a7f383b tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb4c30d0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:23.340383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fbaf7212-4db8-425a-bd9f-aac12a7f383b tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.067580 Apr 30 13:15:23.340989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 244/486] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:23 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:23.353332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-da0f3c71-2832-4e15-a0d0-cc9c0704a43a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2facfb0d0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:23.400676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-da0f3c71-2832-4e15-a0d0-cc9c0704a43a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.053048 Apr 30 13:15:23.401260 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 243/487] 10.222.0.69 () {58 vars in 1140 bytes} [Fri Apr 30 13:15:23 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:23.411825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-948e621d-6dc7-4dd9-b0d2-bb733d088471 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb463af0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:23.459488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-948e621d-6dc7-4dd9-b0d2-bb733d088471 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.051667 Apr 30 13:15:23.460239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 245/488] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:23 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:24.191682 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:24.192287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:24.200375 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:24.200853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:24.201670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:24.202161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:24.412945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:24.423413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:24.424923 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:24.426468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b1b41afe-21c0-4d38-b547-735ecee1de7d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.238272 Apr 30 13:15:24.427007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 244/489] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:24 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:24.472495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b451076f-c22e-4803-920f-65da37598385 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb335700>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:24.522708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b451076f-c22e-4803-920f-65da37598385 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.054990 Apr 30 13:15:24.523647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 246/490] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:24 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:25.445764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:25.446348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:25.454201 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:25.454647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:25.455411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:25.455855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:25.534416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3bc9b560-c1ae-4899-8e89-262771eb3cb2 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb463160>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:25.581988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3bc9b560-c1ae-4899-8e89-262771eb3cb2 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.051134 Apr 30 13:15:25.582653 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 247/491] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:25 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:25.666548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:25.677321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:25.678879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:25.680108 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e764868a-9404-421c-8738-ff70f980b200 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.238319 Apr 30 13:15:25.680802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 245/492] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:25 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:26.595472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-05431777-1f51-4a72-ab16-748605a4488d tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb4c3e50>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:26.640733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-05431777-1f51-4a72-ab16-748605a4488d tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.048916 Apr 30 13:15:26.641304 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 248/493] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:26 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:26.698497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:26.699480 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:26.707600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:26.708055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:26.708845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:26.709283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:26.914218 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:26.923766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:26.925302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:26.926817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5c37cf12-03a9-4249-811b-72466d47cf91 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1808 microversion: 2.20 time: 0.232202 Apr 30 13:15:26.927385 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 246/494] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:26 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:27.652299 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e9a31c99-a749-4543-b4b2-1884b75643da tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fc7b6dc0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:27.701419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e9a31c99-a749-4543-b4b2-1884b75643da tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 288 microversion: 2.1 time: 0.052945 Apr 30 13:15:27.702005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 249/495] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:27 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 288 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:27.713213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b8aa5b47-5065-4346-a95a-00347b162607 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2faaf6940>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:27.820224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b8aa5b47-5065-4346-a95a-00347b162607 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 202 len: 0 microversion: 2.1 time: 0.111089 Apr 30 13:15:27.820883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 247/496] 10.222.0.69 () {58 vars in 1254 bytes} [Fri Apr 30 13:15:27 2021] DELETE /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:15:27.829395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3d267b7a-4d2b-4afd-b6b8-7c8ff7901712 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fc660af0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:27.946827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:27.947502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:27.959227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:27.959719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:27.960835 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:27.961471 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:28.026239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3d267b7a-4d2b-4afd-b6b8-7c8ff7901712 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 200 len: 287 microversion: 2.1 time: 0.200544 Apr 30 13:15:28.026845 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 250/497] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:27 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:28.184391 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:28.194515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:28.196109 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:28.197264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d556aaeb-e139-4ab0-8a27-c6dc8f9ffd19 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1795 microversion: 2.20 time: 0.255603 Apr 30 13:15:28.197864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 248/498] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:15:27 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1795 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:15:29.039688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c78d1567-cb9c-4b39-acca-9c4d5d083584 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb4c30d0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:29.084527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-c78d1567-cb9c-4b39-acca-9c4d5d083584 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] HTTP exception thrown: Snapshot 98d8e517-0dde-43a2-a847-2b04d71d0949 could not be found. Apr 30 13:15:29.085519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c78d1567-cb9c-4b39-acca-9c4d5d083584 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Returning 404 to user: Snapshot 98d8e517-0dde-43a2-a847-2b04d71d0949 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:29.086435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c78d1567-cb9c-4b39-acca-9c4d5d083584 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949" status: 404 len: 111 microversion: 2.1 time: 0.051806 Apr 30 13:15:29.087886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 251/499] 10.222.0.69 () {58 vars in 1251 bytes} [Fri Apr 30 13:15:29 2021] GET /compute/v2.1/os-snapshots/98d8e517-0dde-43a2-a847-2b04d71d0949 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:15:29.096370 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-95267877-47b0-451b-98c1-a6b02c345e2b tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2faaf60d0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:29.198579 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-95267877-47b0-451b-98c1-a6b02c345e2b tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 202 len: 0 microversion: 2.1 time: 0.105954 Apr 30 13:15:29.199179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 249/500] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:15:29 2021] DELETE /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:15:29.208336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-00d4e6f1-6319-4799-af58-6965d92411be tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fc881040>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:29.304860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-00d4e6f1-6319-4799-af58-6965d92411be tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 200 len: 344 microversion: 2.1 time: 0.100768 Apr 30 13:15:29.305516 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 252/501] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:29 2021] GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:30.319012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-05cb08f0-3e88-431a-b37d-2ba62b63eb70 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fae0db80>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:30.382151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-05cb08f0-3e88-431a-b37d-2ba62b63eb70 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] HTTP exception thrown: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. Apr 30 13:15:30.382829 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-05cb08f0-3e88-431a-b37d-2ba62b63eb70 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Returning 404 to user: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:30.383767 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-05cb08f0-3e88-431a-b37d-2ba62b63eb70 tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 404 len: 109 microversion: 2.1 time: 0.069564 Apr 30 13:15:30.384438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 250/502] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:30 2021] GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:15:30.397684 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-525b1272-eb38-4c1c-8f56-5d8f46cfd23a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2fb4c3e50>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:30.461763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-525b1272-eb38-4c1c-8f56-5d8f46cfd23a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] HTTP exception thrown: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. Apr 30 13:15:30.462778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-525b1272-eb38-4c1c-8f56-5d8f46cfd23a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Returning 404 to user: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:30.463735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-525b1272-eb38-4c1c-8f56-5d8f46cfd23a tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 404 len: 109 microversion: 2.1 time: 0.070657 Apr 30 13:15:30.472994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1bd36e50-dcfb-422c-9969-9e5e0e1514ae tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Calling method '.version_select at 0x7fe2facb6ee0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:30.473385 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 253/503] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:15:30 2021] DELETE /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:15:30.556083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-1bd36e50-dcfb-422c-9969-9e5e0e1514ae tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] HTTP exception thrown: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. Apr 30 13:15:30.556761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1bd36e50-dcfb-422c-9969-9e5e0e1514ae tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] Returning 404 to user: Volume 3bd7b969-fdf9-44e1-8166-f985d5793c43 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:30.557680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1bd36e50-dcfb-422c-9969-9e5e0e1514ae tempest-VolumesSnapshotsTestJSON-319233545 tempest-VolumesSnapshotsTestJSON-319233545-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43" status: 404 len: 109 microversion: 2.1 time: 0.089094 Apr 30 13:15:30.558452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 251/504] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:30 2021] GET /compute/v2.1/os-volumes/3bd7b969-fdf9-44e1-8166-f985d5793c43 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:15:32.485277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3ea8a76b-0a73-48ae-a2c9-c955aecb5a72 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Action: 'create', calling method: .version_select at 0x7fe2fc7b31f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2136116228", "metadata": {"Type": "work"}}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:33.107426 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3ea8a76b-0a73-48ae-a2c9-c955aecb5a72 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.807795 Apr 30 13:15:33.108131 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 254/505] 10.222.0.69 () {60 vars in 1156 bytes} [Fri Apr 30 13:15:32 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 13:15:33.120683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-85f64224-4707-47e4-86da-0daab1b7846e tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2faaf6b80>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:33.260412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-85f64224-4707-47e4-86da-0daab1b7846e tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 200 len: 353 microversion: 2.1 time: 0.144092 Apr 30 13:15:33.260984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 252/506] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:33 2021] GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:34.272160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6c8e5510-0766-429b-b1f2-6bfb1c3981fb tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2fb4c38b0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:34.377718 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6c8e5510-0766-429b-b1f2-6bfb1c3981fb tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 200 len: 354 microversion: 2.1 time: 0.109195 Apr 30 13:15:34.378317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 255/507] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:34 2021] GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:34.389806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-46841f11-52bd-4c46-bdf3-cb863d7c5d42 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2fb68a4c0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:34.497164 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-46841f11-52bd-4c46-bdf3-cb863d7c5d42 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 200 len: 354 microversion: 2.1 time: 0.110974 Apr 30 13:15:34.497973 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 253/508] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:34 2021] GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:34.514591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c13bdc4b-d22b-4c86-a2ad-1e056c4972d5 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2fb463160>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:34.617462 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c13bdc4b-d22b-4c86-a2ad-1e056c4972d5 tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 202 len: 0 microversion: 2.1 time: 0.106601 Apr 30 13:15:34.618033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 256/509] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:15:34 2021] DELETE /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:15:34.626789 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7f479fef-38c6-4e34-8b74-aaf442f5ab3c tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2fb68aee0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:34.723822 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7f479fef-38c6-4e34-8b74-aaf442f5ab3c tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 200 len: 353 microversion: 2.1 time: 0.101545 Apr 30 13:15:34.724557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 254/510] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:34 2021] GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:15:35.736122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6e34a947-2bd4-4683-9236-5cd7aa82737f tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Calling method '.version_select at 0x7fe2fc879f70>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:35.806532 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-6e34a947-2bd4-4683-9236-5cd7aa82737f tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] HTTP exception thrown: Volume 59c6cd33-62a4-445a-ba20-6856c88843dc could not be found. Apr 30 13:15:35.807180 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6e34a947-2bd4-4683-9236-5cd7aa82737f tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] Returning 404 to user: Volume 59c6cd33-62a4-445a-ba20-6856c88843dc could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:15:35.808065 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6e34a947-2bd4-4683-9236-5cd7aa82737f tempest-VolumesGetTestJSON-570984760 tempest-VolumesGetTestJSON-570984760-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc" status: 404 len: 109 microversion: 2.1 time: 0.075830 Apr 30 13:15:35.808606 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 257/511] 10.222.0.69 () {58 vars in 1245 bytes} [Fri Apr 30 13:15:35 2021] GET /compute/v2.1/os-volumes/59c6cd33-62a4-445a-ba20-6856c88843dc => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:15:41.701798 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:15:41.705466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1830766831", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1313915457", "security_groups": [{"name": "tempest-secgroup-smoke-723591243"}], "networks": [{"uuid": "66923575-b46e-40eb-b42a-88dc2b7e5194"}], "block_device_mapping_v2": [{"uuid": "5de60894-c216-4128-bf50-cd7d0e0e71ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:41.899649 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] validate_networks() for [('66923575-b46e-40eb-b42a-88dc2b7e5194', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:15:42.614759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:15:42.615220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:15:42.615691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:15:42.616100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:15:42.616512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:15:42.629292 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:42.630144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:42.632132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:42.633118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:42.671911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:15:42.679396 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Getting quotas for user 5c88c75fe03843c9ad120269832bc227 and project 2e010a31d7104f119fb0a3ab9fe7e8bc. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:15:42.722406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 51958. Apr 30 13:15:42.797165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:15:42.799674 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5de60894-c216-4128-bf50-cd7d0e0e71ff',volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:15:43.027869 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6bcfaa98-c3a1-4519-897a-f47ad374b812 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.327451 Apr 30 13:15:43.029113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 255/512] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:15:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 13:15:43.051146 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e166a0e4-b1ff-4043-be49-653c489e6b0a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:43.053363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e166a0e4-b1ff-4043-be49-653c489e6b0a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:43.188156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e166a0e4-b1ff-4043-be49-653c489e6b0a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:43.197227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e166a0e4-b1ff-4043-be49-653c489e6b0a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1089 microversion: 2.1 time: 0.157433 Apr 30 13:15:43.198325 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 258/513] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:43 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1089 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:44.216035 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:44.216765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:44.224941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:44.225461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:44.226317 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:44.226761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:44.346428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:44.355824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-54a923df-392b-446d-9b47-9520b3509cb8 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1187 microversion: 2.1 time: 0.143746 Apr 30 13:15:44.356401 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 256/514] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:44 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1187 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:15:45.373275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:45.374041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:45.383137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:45.384199 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:45.385258 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:45.385901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:45.551128 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:45.561284 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-08d8b71a-3a46-426b-9092-fd5aba30841b tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1205 microversion: 2.1 time: 0.191748 Apr 30 13:15:45.572255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 259/515] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:45 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1205 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:46.579796 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:46.580400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:46.588983 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:46.590331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:46.592125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:46.592771 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:46.886008 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:46.895922 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-69908cf3-4d9a-480c-9a74-dccd4598fe00 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.319884 Apr 30 13:15:46.906552 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 257/516] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:46 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:47.142056 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-3e2783ca-5908-44bd-8394-3ab3f40c311b req-b67ba24b-bc72-4672-900e-436c91a89773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:47.143839 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:15:47.143839 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:15:47.155526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3e2783ca-5908-44bd-8394-3ab3f40c311b req-b67ba24b-bc72-4672-900e-436c91a89773 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:47.156018 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3e2783ca-5908-44bd-8394-3ab3f40c311b req-b67ba24b-bc72-4672-900e-436c91a89773 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:47.200707 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-3e2783ca-5908-44bd-8394-3ab3f40c311b req-b67ba24b-bc72-4672-900e-436c91a89773 service nova] Creating event network-changed:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:15:47.209673 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-3e2783ca-5908-44bd-8394-3ab3f40c311b req-b67ba24b-bc72-4672-900e-436c91a89773 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076243 Apr 30 13:15:47.210547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 260/517] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:47.914055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:47.914673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:47.927184 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:47.928151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:47.929280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:47.930149 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:48.210013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:48.219440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-df1be16e-4cfd-4ea9-b49c-106503f77c5d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.309232 Apr 30 13:15:48.220394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 258/518] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:47 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:49.239084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:49.240804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:49.252590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:49.253115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:49.254405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:49.254983 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:49.474829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:49.487512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-445da77f-e84a-4982-b7ed-36150c278005 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.254041 Apr 30 13:15:49.499824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 261/519] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:49 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:50.507014 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:50.507784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:50.515627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:50.516071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:50.516858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:50.517301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:50.727419 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:50.737577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5ecf380d-3f2e-4605-adda-5769d5956fca tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.233764 Apr 30 13:15:50.738249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 259/520] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:50 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:51.755032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:51.755646 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:51.763897 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:51.764349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:51.765124 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:51.765592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:52.161955 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:52.170540 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e74d6664-ee36-4b35-8997-10c2e76889ff tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.419451 Apr 30 13:15:52.171416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 262/521] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:51 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:53.188801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:53.189444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:53.197296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:53.197788 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:53.198577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:53.199021 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:53.413276 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:53.422188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-56bba7c0-37f2-42f7-8ab4-6e21484eb4b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.237665 Apr 30 13:15:53.422778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 260/522] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:53 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:54.440852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:54.442338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:54.453356 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:54.454313 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:54.455401 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:54.456225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:54.677925 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:54.687639 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bd4c5431-bf37-4a9b-a86e-e75bc5f9a185 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.251627 Apr 30 13:15:54.688119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 263/523] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:54 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:55.708158 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:55.709249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:55.722568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:55.723144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:55.724194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:55.724950 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:55.947356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:55.956600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8b472870-7d89-4abc-82a9-3b189dd644f5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.255021 Apr 30 13:15:55.957140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 261/524] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:55 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:56.445938 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-2aa568e9-c1e8-4a3e-ace5-00a56d416f5f req-f606bf26-b978-4929-8b44-4dbfdb6216fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "name": "network-vif-plugged", "status": "completed", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:15:56.449216 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:15:56.449216 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:15:56.467315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2aa568e9-c1e8-4a3e-ace5-00a56d416f5f req-f606bf26-b978-4929-8b44-4dbfdb6216fd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:56.468121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2aa568e9-c1e8-4a3e-ace5-00a56d416f5f req-f606bf26-b978-4929-8b44-4dbfdb6216fd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:56.503328 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-2aa568e9-c1e8-4a3e-ace5-00a56d416f5f req-f606bf26-b978-4929-8b44-4dbfdb6216fd service nova] Creating event network-vif-plugged:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:15:56.513336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-2aa568e9-c1e8-4a3e-ace5-00a56d416f5f req-f606bf26-b978-4929-8b44-4dbfdb6216fd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073500 Apr 30 13:15:56.514583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 264/525] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:15:56.973797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:56.975214 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:56.983629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:56.984483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:56.985571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:56.986224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:57.238712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:57.253629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f8564eba-7531-4626-9451-80390b945261 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.283288 Apr 30 13:15:57.254195 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 262/526] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:56 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:58.272049 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:58.272817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:58.280999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:58.281500 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:58.282336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:58.282789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:58.689880 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:58.699676 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7494c3e1-62a9-40c1-8bb7-2af5c8ea26c0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1260 microversion: 2.1 time: 0.432124 Apr 30 13:15:58.700277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 265/527] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:58 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:59.716296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:59.716931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:59.726121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:59.727119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:59.728373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:59.728916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:59.940961 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:15:59.949721 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-72cdacb5-12b7-4c34-b536-757b7eade985 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1444 microversion: 2.1 time: 0.237265 Apr 30 13:15:59.957278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 263/528] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:59 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1444 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:15:59.967132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:15:59.968848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:15:59.977473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:59.978374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:15:59.979234 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:15:59.979643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.069897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03b29009-cc2c-4533-95f8-b6a887b4f7c6", "device": "/dev/sdb"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:00.071645 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:00.080119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.080569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.081467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.082085 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.216310 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:00.225327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dcc0fe9b-7b7e-46d3-bf76-672bcc7ad487 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1444 microversion: 2.1 time: 0.261950 Apr 30 13:16:00.229635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 266/529] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:15:59 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1444 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:00.667972 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3dafc82d-15f9-4db0-bce6-0d1ae1c8eea7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "POST /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601703 Apr 30 13:16:00.668861 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 264/530] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:16:00 2021] POST /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956/os-volume_attachments => generated 194 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:03.106750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-878ed7cf-5b27-4299-9f4b-a38d09a4e7d4 req-7f9f9c4d-b009-484a-8e09-f0cff833a8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:03.108447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:03.108447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:03.117848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-878ed7cf-5b27-4299-9f4b-a38d09a4e7d4 req-7f9f9c4d-b009-484a-8e09-f0cff833a8c6 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:03.118293 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-878ed7cf-5b27-4299-9f4b-a38d09a4e7d4 req-7f9f9c4d-b009-484a-8e09-f0cff833a8c6 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:03.135489 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-878ed7cf-5b27-4299-9f4b-a38d09a4e7d4 req-7f9f9c4d-b009-484a-8e09-f0cff833a8c6 service nova] Creating event network-changed:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:16:03.140395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-878ed7cf-5b27-4299-9f4b-a38d09a4e7d4 req-7f9f9c4d-b009-484a-8e09-f0cff833a8c6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037724 Apr 30 13:16:03.141031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 267/531] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:04.290057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:04.290578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:04.302644 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:04.303133 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:04.303894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:04.304466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:04.372419 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-067d93a6-8360-4246-92e2-4f2def947172 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments/c9a21605-7baa-4916-a54c-d3af5ce6766c" status: 200 len: 194 microversion: 2.20 time: 0.087416 Apr 30 13:16:04.373034 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 265/532] 10.222.0.69 () {60 vars in 1454 bytes} [Fri Apr 30 13:16:04 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments/c9a21605-7baa-4916-a54c-d3af5ce6766c => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:16:04.492470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:04.493218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:04.500987 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:04.501494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:04.503455 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:04.503455 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:04.679664 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lazy-loading 'services' on Instance uuid b4d095de-4619-4350-a486-c7238d32b916 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:16:04.824618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-484e5bf6-58ef-4628-8333-1c5619622e45 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments/c9a21605-7baa-4916-a54c-d3af5ce6766c" status: 202 len: 0 microversion: 2.20 time: 0.336323 Apr 30 13:16:04.825651 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 268/533] 10.222.0.69 () {60 vars in 1457 bytes} [Fri Apr 30 13:16:04 2021] DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916/os-volume_attachments/c9a21605-7baa-4916-a54c-d3af5ce6766c => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:16:09.355132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:09.355726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:09.366630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:09.366630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:09.366630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:09.366630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:09.441176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:16:09.573044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8090b055-cb55-49de-a643-30d015d317d9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 204 len: 0 microversion: 2.20 time: 0.221409 Apr 30 13:16:09.573660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 266/534] 10.222.0.69 () {60 vars in 1280 bytes} [Fri Apr 30 13:16:09 2021] DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 30 13:16:09.583778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:09.584969 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:09.593920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:09.594377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:09.595220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:09.596008 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:09.804974 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:09.814841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:09.816383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:09.817641 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e5396b49-7046-405c-a4f8-6896ee87efb3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.239071 Apr 30 13:16:09.818213 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 269/535] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:09 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:10.837546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:10.838276 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:10.846410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:10.846865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:10.847661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:10.848093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:11.063530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:11.073861 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:11.075622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:11.076851 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1c6262ca-7872-40c6-a8b5-fb9793d41f97 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.243769 Apr 30 13:16:11.077480 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 267/536] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:10 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:12.096728 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:12.097405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:12.105616 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:12.106066 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:12.106854 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:12.107288 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:12.304351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:12.314674 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:12.316586 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:12.317792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fd9686e9-984f-4b30-a938-c153de7eb873 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.225075 Apr 30 13:16:12.318330 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 270/537] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:12 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:13.336685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:13.337635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:13.345225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:13.345827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:13.346766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:13.347619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:13.661679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:13.672287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:13.673895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:13.675518 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-25efe366-5c55-41c8-ad35-c64c17f8d945 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.342550 Apr 30 13:16:13.676286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 268/538] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:13 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:14.696140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:14.696786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:14.704747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:14.705324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:14.706278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:14.706851 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:14.914684 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:14.924080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:14.925956 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:14.927106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c6c63ba8-8f54-48a5-b88d-7934a3722220 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.235064 Apr 30 13:16:14.927690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 271/539] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:14 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:15.945999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:15.946602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:15.955186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:15.957195 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:15.958177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:15.958630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:16.176994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:16.187299 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:16.188809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:16.189999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-da6e8038-4681-4b3e-8a43-323f95831b00 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.247988 Apr 30 13:16:16.191483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 269/540] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:15 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:17.120453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:17.121124 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:17.131685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.132361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.133315 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.133839 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.198280 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:16:17.208311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:17.208978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:17.216679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.217175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.218256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.218695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.319575 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ce769fa9-99c7-41b9-91d2-91768442dedf tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 204 len: 0 microversion: 2.1 time: 0.203717 Apr 30 13:16:17.320361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 272/541] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:16:17 2021] DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:16:17.329850 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:17.330733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:17.343305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.344098 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.345195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:17.345735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:17.433594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:17.445535 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:17.448580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:17.450407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c38539b6-0d5b-4838-bb46-d7a136c6f12d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1723 microversion: 2.20 time: 0.246000 Apr 30 13:16:17.452228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 270/542] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:17 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:17.592555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:17.601911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4a3fceed-2ffb-4e51-9214-ce3cdca80695 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1674 microversion: 2.1 time: 0.276556 Apr 30 13:16:17.602852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 273/543] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:17 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:18.468759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:18.469420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:18.478182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:18.478637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:18.484412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:18.484873 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:18.604628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:18.614325 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:18.615919 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:18.617430 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a7882be6-3cb1-4667-9251-d2c17e4c18c0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1656 microversion: 2.20 time: 0.152884 Apr 30 13:16:18.617933 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 271/544] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:18 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:18.620605 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:18.621295 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:18.632314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:18.632859 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:18.633765 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:18.634281 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:18.891620 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-8d4f8e67-59d4-427a-8942-b9d90ed8ff37 req-85398468-8d14-4aff-bf68-115d6fdf74af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4d095de-4619-4350-a486-c7238d32b916", "name": "network-vif-deleted", "tag": "0cd7dfae-50d3-4898-bc92-62023a8d0059"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:18.894657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:18.894657 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:16:18.908824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:18.910080 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8d4f8e67-59d4-427a-8942-b9d90ed8ff37 req-85398468-8d14-4aff-bf68-115d6fdf74af service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:18.910797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8d4f8e67-59d4-427a-8942-b9d90ed8ff37 req-85398468-8d14-4aff-bf68-115d6fdf74af service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:18.919419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bbc5e886-2ec9-4d0c-8135-1d338c68eff8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1674 microversion: 2.1 time: 0.302773 Apr 30 13:16:18.930325 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 274/545] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:18 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1674 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:18.932571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-8d4f8e67-59d4-427a-8942-b9d90ed8ff37 req-85398468-8d14-4aff-bf68-115d6fdf74af service nova] Creating event network-vif-deleted:0cd7dfae-50d3-4898-bc92-62023a8d0059 for instance b4d095de-4619-4350-a486-c7238d32b916 on hv-cinder-78445 Apr 30 13:16:18.938442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-8d4f8e67-59d4-427a-8942-b9d90ed8ff37 req-85398468-8d14-4aff-bf68-115d6fdf74af service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054566 Apr 30 13:16:18.939379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 272/546] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:19.635441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:19.636179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:19.644748 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:19.645203 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:19.646103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:19.646537 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:19.683013 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6815a720-f661-42e1-836f-53dcb090aad7] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:16:19.765068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:19.775680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:19.777437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:19.778699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-05a480d5-5db9-4895-a17b-66094d96fae7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1656 microversion: 2.20 time: 0.147011 Apr 30 13:16:19.779160 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 275/547] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:19 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1656 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:19.938592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:19.939377 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:19.947742 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:19.948349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:19.949197 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:19.949751 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:20.161564 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:20.171058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ca75277b-a57f-4b23-9dc7-9195efb2ce93 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1674 microversion: 2.1 time: 0.236590 Apr 30 13:16:20.179581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 273/548] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:19 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:20.797305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:20.797920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:20.818071 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:20.818519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:20.819338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:20.819852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:20.848171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] [6815a720-f661-42e1-836f-53dcb090aad7] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 52630. Apr 30 13:16:20.937712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:20.946763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:20.948227 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:20.949472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3ee6ae65-c3c7-4391-b5ac-3cbe4960a46d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 200 len: 1366 microversion: 2.20 time: 0.156014 Apr 30 13:16:20.949960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 276/549] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:20 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:21.189589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:21.190147 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:21.198203 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:21.198661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:21.199490 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:21.199951 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:21.411523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:21.420684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-eb1f5a48-d48b-4f2a-9215-6a15fbe8a334 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1674 microversion: 2.1 time: 0.236012 Apr 30 13:16:21.421234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 274/550] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:21 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:21.967420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:21.968187 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:21.976409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:21.976861 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:21.977680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:21.978115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:22.036744 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. Apr 30 13:16:22.037267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:22.038219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6eed05cd-b21e-47ed-b2a4-0642f3ab0c1e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 404 len: 111 microversion: 2.20 time: 0.074788 Apr 30 13:16:22.038813 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 277/551] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:21 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:16:22.048120 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-55bb4df3-207d-4948-9996-7045a58d6826 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '.version_select at 0x7fe2fb68a790>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:22.070751 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-55bb4df3-207d-4948-9996-7045a58d6826 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607199296" status: 204 len: 0 microversion: 2.20 time: 0.026593 Apr 30 13:16:22.071441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 275/552] 10.222.0.69 () {60 vars in 1262 bytes} [Fri Apr 30 13:16:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607199296 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:16:22.439239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:22.439845 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:22.453217 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:22.454118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:22.455849 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:22.456590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:23.034492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:23.045151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-72387fe7-abc4-4d88-b211-61ce033286ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1674 microversion: 2.1 time: 0.609929 Apr 30 13:16:23.046073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 278/553] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:22 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1674 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:23.376372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: .version_select at 0x7fe2faa9af70>, body: {"keypair": {"name": "tempest-keypair-134523763"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:23.401033 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:23.406400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:23.596690 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:23.600825 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:23.616468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3064d3e1-1835-4025-bebc-19d73d9449df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.243970 Apr 30 13:16:23.622179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 276/554] 10.222.0.69 () {62 vars in 1199 bytes} [Fri Apr 30 13:16:23 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 246 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:16:23.886606 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-fb21dcd3-4144-43b6-a8b0-d1df13bf2f72 req-7a3d7047-5e35-4f52-aed8-7f01799bec8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9504e6a6-a9cf-4f1a-a169-eea54daf121c", "name": "network-vif-deleted", "tag": "cff078e8-b239-45de-a9b9-daa6482b64f4"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:23.890282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:23.890282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:23.901061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fb21dcd3-4144-43b6-a8b0-d1df13bf2f72 req-7a3d7047-5e35-4f52-aed8-7f01799bec8d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:23.901848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fb21dcd3-4144-43b6-a8b0-d1df13bf2f72 req-7a3d7047-5e35-4f52-aed8-7f01799bec8d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:23.921511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-fb21dcd3-4144-43b6-a8b0-d1df13bf2f72 req-7a3d7047-5e35-4f52-aed8-7f01799bec8d service nova] Creating event network-vif-deleted:cff078e8-b239-45de-a9b9-daa6482b64f4 for instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c on hv-cinder-78445 Apr 30 13:16:23.927706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-fb21dcd3-4144-43b6-a8b0-d1df13bf2f72 req-7a3d7047-5e35-4f52-aed8-7f01799bec8d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045714 Apr 30 13:16:23.930703 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 279/555] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:24.062904 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:24.063549 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:24.080908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:24.081168 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:24.082190 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:24.082991 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:24.157311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:24.158254 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:24.158859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lazy-loading 'fault' on Instance uuid 9504e6a6-a9cf-4f1a-a169-eea54daf121c {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:16:24.431449 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:24.443768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fd62474d-08b5-4c70-ae0f-513c67b89151 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 200 len: 1328 microversion: 2.1 time: 0.385073 Apr 30 13:16:24.455442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 277/556] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:24 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 1328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:25.469178 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:25.470825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:25.480233 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:25.480969 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:25.481982 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:25.482565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:25.538561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. Apr 30 13:16:25.539169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:25.540033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-717fb50f-d9eb-4c96-a632-1fd1de3ca645 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 404 len: 111 microversion: 2.1 time: 0.078501 Apr 30 13:16:25.540603 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 280/557] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:25 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:16:25.548996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5399913a-e9a6-4525-8c6e-2cbbc4537dd0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '.version_select at 0x7fe2faa67160>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:25.567837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5399913a-e9a6-4525-8c6e-2cbbc4537dd0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170106625" status: 202 len: 0 microversion: 2.1 time: 0.022521 Apr 30 13:16:25.568518 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 278/558] 10.222.0.69 () {58 vars in 1221 bytes} [Fri Apr 30 13:16:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170106625 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:16:25.617493 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:25.617999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:25.623953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1349419058", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "384ed945-7697-4aed-a91c-b54f67f71379"}], "security_groups": [{"name": "tempest-securitygroup--850377254"}], "key_name": "tempest-keypair-134523763", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:25.626578 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:25.627038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:25.628057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:25.628494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:25.793528 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] validate_networks() for [('384ed945-7697-4aed-a91c-b54f67f71379', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:25.992956 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lazy-loading 'services' on Instance uuid bc7f5373-9990-486e-b303-1e46fc75e956 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:16:26.173816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1653f0c3-d189-4a78-b9b9-a12911082894 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956/os-volume_attachments/03b29009-cc2c-4533-95f8-b6a887b4f7c6" status: 202 len: 0 microversion: 2.1 time: 0.560187 Apr 30 13:16:26.178449 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 281/559] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:16:25 2021] DELETE /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956/os-volume_attachments/03b29009-cc2c-4533-95f8-b6a887b4f7c6 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:16:26.495332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:26.496093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:26.496784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:26.497438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:26.498087 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:26.509607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:26.510067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:26.510885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:26.511503 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:26.530582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for project a397097db8304460991aa7950d00f829. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:26.534671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Getting quotas for user c38688227e014d68a4d5ff7f21f83168 and project a397097db8304460991aa7950d00f829. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:26.545627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:26.548134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:26.611633 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6e4c3fa4-0742-46df-9b3a-05a55515eca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.992169 Apr 30 13:16:26.612741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 279/560] 10.222.0.69 () {62 vars in 1188 bytes} [Fri Apr 30 13:16:25 2021] POST /compute/v2.1/servers => generated 401 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 30 13:16:26.624984 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:26.626333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:26.708061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:26.720721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:26.723613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:26.724807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-95b264d1-e2cc-4a70-b821-88ab3ca5c333 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1281 microversion: 2.20 time: 0.104325 Apr 30 13:16:26.735504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 282/561] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:26 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:27.010727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: .version_select at 0x7fe2fa9abd30>, body: {"keypair": {"name": "tempest-keypair-476636242"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:27.034474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:27.038830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:27.241753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:27.246998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:27.264056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-775b20dc-4b65-4f9b-98a1-bc5e98fc2893 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.257072 Apr 30 13:16:27.264277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 280/562] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Apr 30 13:16:27 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:27.742693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:27.743456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:27.758876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:27.759561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:27.760931 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:27.761747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:27.926847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:27.946913 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:27.949323 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:27.950849 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ae0ecbff-f142-46ad-b35a-cb026bc574b6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1333 microversion: 2.20 time: 0.212177 Apr 30 13:16:27.951946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 283/563] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:27 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1333 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:28.519193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:28.519755 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:28.527414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.527859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.528632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.529171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.596309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:16:28.729768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b32792ce-d0a3-4cd7-9968-4820efb0232a tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 204 len: 0 microversion: 2.1 time: 0.214012 Apr 30 13:16:28.730380 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 281/564] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:16:28 2021] DELETE /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:16:28.738885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:28.739504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:28.747841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.748573 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.749079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.749558 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.969819 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:28.970866 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:28.972016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:28.978984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.979534 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.980584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:28.981138 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:28.981584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-44eb56b8-61f4-4045-a339-53e5c3744112 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1514 microversion: 2.1 time: 0.246591 Apr 30 13:16:28.991137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 284/565] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:28 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:29.101261 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:29.111274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:29.112994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:29.114320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-964be5de-f6c9-4dac-9433-3bf8e45ee432 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1339 microversion: 2.20 time: 0.148858 Apr 30 13:16:29.115487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 282/566] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:28 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1339 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:29.998644 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:30.000104 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:30.008567 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:30.009158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:30.010382 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:30.010966 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:30.137689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:30.138398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:30.155984 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:30.156962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:30.158244 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:30.158844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:30.361450 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:30.370688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e0c189de-0281-4192-b050-d5de76f90578 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1514 microversion: 2.1 time: 0.376413 Apr 30 13:16:30.371457 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 285/567] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:29 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:30.376554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1841389060", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8d1fd53-0ee5-499f-9667-97dbc79cf1ea"}], "security_groups": [{"name": "tempest-securitygroup--1611685372"}], "key_name": "tempest-keypair-476636242", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:30.501527 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:30.516409 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:30.518777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:30.523122 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b3f2a0aa-2c83-477a-b445-dae3249952a7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.392220 Apr 30 13:16:30.525119 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 283/568] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:30 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:30.549195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] validate_networks() for [('b8d1fd53-0ee5-499f-9667-97dbc79cf1ea', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:31.240814 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-4c572d5d-be00-4766-baf3-6962e04f1781 req-a1617388-9b4c-4fe8-b861-a91c1f2653dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:31.246142 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:31.246142 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:16:31.259566 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-4c572d5d-be00-4766-baf3-6962e04f1781 req-a1617388-9b4c-4fe8-b861-a91c1f2653dc service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.270251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-4c572d5d-be00-4766-baf3-6962e04f1781 req-a1617388-9b4c-4fe8-b861-a91c1f2653dc service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.460302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-4c572d5d-be00-4766-baf3-6962e04f1781 req-a1617388-9b4c-4fe8-b861-a91c1f2653dc service nova] Creating event network-changed:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:16:31.465470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-4c572d5d-be00-4766-baf3-6962e04f1781 req-a1617388-9b4c-4fe8-b861-a91c1f2653dc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237542 Apr 30 13:16:31.466842 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 284/569] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:31.472107 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:31.472818 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:31.480747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.481809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.482994 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.483607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.704342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:31.705027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:31.706157 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:31.706649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:31.707179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:31.717466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.717892 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.718773 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.719454 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.750053 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:31.756637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Getting quotas for user 7079ac80265c4901a3193aa27a46c1be and project 8c3daf98030a4f9983829bc893d1c2a1. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:31.772652 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:31.775973 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:31.832275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4d47ade6-8cb0-4f56-968e-1f2d5f835c4b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.459489 Apr 30 13:16:31.833337 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 286/570] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:16:30 2021] POST /compute/v2.1/servers => generated 402 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:16:31.841127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:31.842177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:31.850397 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.851090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:31.851894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:31.852341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:32.026626 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:32.043155 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5f872060-d42d-4ead-a307-c4a188a48f94 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1514 microversion: 2.1 time: 0.574577 Apr 30 13:16:32.044321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 285/571] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:31 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1514 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:32.064454 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-515acd52-1180-40a6-948d-908fb0de0390 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:32.065858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-515acd52-1180-40a6-948d-908fb0de0390 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:32.196622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-515acd52-1180-40a6-948d-908fb0de0390 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:32.205647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-515acd52-1180-40a6-948d-908fb0de0390 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1237 microversion: 2.1 time: 0.145803 Apr 30 13:16:32.206940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 286/572] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:32 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1237 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:32.219433 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:32.230021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:32.232658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:32.234064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-cc165238-6955-42aa-b24c-3053e7ba38ff tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.397028 Apr 30 13:16:32.234871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 287/573] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:31 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:32.459273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-1aa07361-d65f-4e8a-85e6-fab5f29f1200 req-638b64ff-8449-484f-bdff-d60cda75fbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7f5373-9990-486e-b303-1e46fc75e956", "name": "network-vif-deleted", "tag": "e679c56c-ca0d-455a-aea9-2cf760a03f8d"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:32.461736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:32.461736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:16:32.472012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-1aa07361-d65f-4e8a-85e6-fab5f29f1200 req-638b64ff-8449-484f-bdff-d60cda75fbac service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:32.472738 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-1aa07361-d65f-4e8a-85e6-fab5f29f1200 req-638b64ff-8449-484f-bdff-d60cda75fbac service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:32.493202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-1aa07361-d65f-4e8a-85e6-fab5f29f1200 req-638b64ff-8449-484f-bdff-d60cda75fbac service nova] Creating event network-vif-deleted:e679c56c-ca0d-455a-aea9-2cf760a03f8d for instance bc7f5373-9990-486e-b303-1e46fc75e956 on hv-cinder-78445 Apr 30 13:16:32.500628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-1aa07361-d65f-4e8a-85e6-fab5f29f1200 req-638b64ff-8449-484f-bdff-d60cda75fbac service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045233 Apr 30 13:16:32.501978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 287/574] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:33.068823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:33.068823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:33.078091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.078976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.080114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.080786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.172919 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.173396 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.173851 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lazy-loading 'fault' on Instance uuid bc7f5373-9990-486e-b303-1e46fc75e956 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:16:33.229526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:33.232347 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:33.242435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.243192 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.244061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.244824 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.445974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:33.461229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:33.476632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8b7c28a0-53fb-4ad3-be17-272053f5f101 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1297 microversion: 2.1 time: 0.249693 Apr 30 13:16:33.480088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 288/575] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:33 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1297 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:33.489203 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:33.490636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:33.501660 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dca4c6d9-a1ec-4baf-a8fe-ac38be2dceda tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 200 len: 1309 microversion: 2.1 time: 0.441969 Apr 30 13:16:33.504302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.504302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:33.507266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 288/576] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:33 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:33.516917 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:33.521826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:34.034507 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:34.044000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:34.045656 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:34.060451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-69612f43-8877-445e-ac3f-e95430cc0e63 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.578532 Apr 30 13:16:34.061015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 289/577] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:33 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:34.496207 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:34.496804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:34.504141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:34.504983 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:34.506027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:34.507555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:34.522381 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:34.522990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: bc7f5373-9990-486e-b303-1e46fc75e956] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:34.544830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:34.545568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:34.547067 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:34.547736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:34.621798 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] HTTP exception thrown: Instance bc7f5373-9990-486e-b303-1e46fc75e956 could not be found. Apr 30 13:16:34.622902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Returning 404 to user: Instance bc7f5373-9990-486e-b303-1e46fc75e956 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:34.624394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a8344ff3-6219-4eef-9e08-9ff5cf94cea4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956" status: 404 len: 111 microversion: 2.1 time: 0.105601 Apr 30 13:16:34.625396 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 290/578] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:34 2021] GET /compute/v2.1/servers/bc7f5373-9990-486e-b303-1e46fc75e956 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:16:35.083176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:35.084279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:35.099484 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:35.102709 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:35.103698 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:35.104649 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:35.287061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:35.297147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-716dfe02-c750-491a-8db9-e8ea0689997c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.804528 Apr 30 13:16:35.297879 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 289/579] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:34 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:16:35.725032 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:35.735585 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:35.737715 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:35.738878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1c2d12ec-0a66-4f1e-8fd2-8106b9775a6b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.663234 Apr 30 13:16:35.739850 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 291/580] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:35 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:36.244459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-3925d796-deef-4b8d-a386-0f802dd15bdf req-5bc041e2-dbb5-4fde-9920-0b602aabe786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d187a24a-965f-4bdb-8ec9-e4ea19635718", "tag": "8abba6c9-b97f-4068-84b0-6fbd520ca4ba"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:36.249057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:36.249057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:36.262890 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3925d796-deef-4b8d-a386-0f802dd15bdf req-5bc041e2-dbb5-4fde-9920-0b602aabe786 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:36.263341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3925d796-deef-4b8d-a386-0f802dd15bdf req-5bc041e2-dbb5-4fde-9920-0b602aabe786 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:36.293795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-3925d796-deef-4b8d-a386-0f802dd15bdf req-5bc041e2-dbb5-4fde-9920-0b602aabe786 service nova] Creating event network-changed:8abba6c9-b97f-4068-84b0-6fbd520ca4ba for instance d187a24a-965f-4bdb-8ec9-e4ea19635718 on hv-cinder-78445 Apr 30 13:16:36.301680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-3925d796-deef-4b8d-a386-0f802dd15bdf req-5bc041e2-dbb5-4fde-9920-0b602aabe786 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061049 Apr 30 13:16:36.302936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 290/581] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:36.315499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:36.317528 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:36.329938 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:36.330420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:36.331470 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:36.331922 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:36.601637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:36.611166 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-669d27f3-4cc7-4673-8033-02c912a2855d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.299938 Apr 30 13:16:36.611784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 292/582] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:36 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:36.757989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:36.759093 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:36.768169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:36.768918 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:36.770042 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:36.770475 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:37.033941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:37.044261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:37.045968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:37.047252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-535d2260-9d41-4bc9-bb43-3e0108f8af5f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.294442 Apr 30 13:16:37.048692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 291/583] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:36 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:37.630112 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:37.630718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:37.639477 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:37.639936 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:37.640791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:37.641228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:37.854124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:37.865272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-15931365-af79-4e09-802a-f6c2560908f6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.240213 Apr 30 13:16:37.875270 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 293/584] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:37 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:38.072972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:38.075285 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:38.090908 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:38.092069 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:38.093712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:38.095912 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:38.602464 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:38.616225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:38.617752 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:38.618873 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8ba51d38-e28f-451b-9d9c-f5235651258a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.555376 Apr 30 13:16:38.633547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 292/585] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:38 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:38.883489 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:38.885180 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:38.901771 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:38.903513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:38.905176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:38.907486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:39.342390 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:39.357830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-68b5d3c6-260e-4b02-abb3-e31e4c57e691 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.478001 Apr 30 13:16:39.359513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 294/586] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:38 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:39.640672 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:39.641965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:39.651461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:39.652810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:39.653797 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:39.654389 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:39.904371 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:39.915311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:39.917271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:39.918695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-89113dea-8bef-4a02-bf55-09fbf6b53a26 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.285104 Apr 30 13:16:39.919600 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 293/587] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:39 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:40.375847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:40.376852 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:40.385756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:40.386485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:40.387438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:40.387876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:40.639735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:40.657005 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8893aa86-51ef-4231-aa30-d908a577e175 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.285750 Apr 30 13:16:40.657577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 295/588] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:40 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:40.939187 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:40.940691 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:40.948840 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:40.949402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:40.950301 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:40.950803 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:41.203621 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:41.214809 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:41.216757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:41.218433 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-345bb717-5a86-4ead-9ba9-47eabdc277f2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.283492 Apr 30 13:16:41.219555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 294/589] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:40 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:42.042511 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:42.043929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:42.052731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.053502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.054594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.055261 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.238601 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:42.239229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:42.247398 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.248103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.249497 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.250294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.319439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:42.331639 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-33711158-9b02-4c7c-a801-435808a5358d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.661083 Apr 30 13:16:42.332272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 296/590] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:41 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:42.500232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:42.511101 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:42.512918 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:42.514253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7a8cb821-c5c9-4bfa-ad67-4ccba7af9b0c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.279492 Apr 30 13:16:42.526564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 295/591] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:42 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:43.352909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:43.352909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:43.363520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:43.363876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:43.364711 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:43.365220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:43.532214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:43.532839 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:43.548998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:43.549483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:43.554144 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:43.554671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:43.612757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:43.624439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-457f068d-9803-4ec5-abdd-79a2d521de7d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.279546 Apr 30 13:16:43.625407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 297/592] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:43 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:43.630515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-187821995", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "5afe9a73-d521-4fe7-94d1-3d1ec432eca5"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:43.715137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] validate_networks() for [('5afe9a73-d521-4fe7-94d1-3d1ec432eca5', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:44.062080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:44.076586 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:44.078246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:44.079490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-285d317f-5038-456c-9147-c8dabc28066e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.551287 Apr 30 13:16:44.093715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 296/593] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:43 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:44.178849 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-b1ff9b52-78ec-4241-9a7a-6ae220331746 req-89cb1553-a413-4bf5-9879-51602886e962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "name": "network-vif-plugged", "status": "completed", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:44.182311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:44.182311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:44.198182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-b1ff9b52-78ec-4241-9a7a-6ae220331746 req-89cb1553-a413-4bf5-9879-51602886e962 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:44.198948 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-b1ff9b52-78ec-4241-9a7a-6ae220331746 req-89cb1553-a413-4bf5-9879-51602886e962 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:44.230562 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-b1ff9b52-78ec-4241-9a7a-6ae220331746 req-89cb1553-a413-4bf5-9879-51602886e962 service nova] Creating event network-vif-plugged:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:16:44.245433 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-b1ff9b52-78ec-4241-9a7a-6ae220331746 req-89cb1553-a413-4bf5-9879-51602886e962 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072376 Apr 30 13:16:44.246936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 297/594] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:44.610334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:44.611617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:44.612297 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:44.612898 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:44.613724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:44.624854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:44.625610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:44.626603 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:44.627286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:44.642960 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:44.643720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:44.649764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Getting quotas for project 95a5f6800c42410c8d7a418f920d9cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:44.654948 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Getting quotas for user 36e37e66ad414cbf92ef84bfab15339e and project 95a5f6800c42410c8d7a418f920d9cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:44.662245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:44.662859 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:44.663581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:44.665902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:44.668365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:44.671112 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:44.731316 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-64017398-9eaf-40f6-b9bb-8a3153ac96f5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104319 Apr 30 13:16:44.733269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 298/595] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:16:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:16:44.744976 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2f7a1127-b3b9-43ab-a9d1-d4eea5f6bffb tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:44.746623 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2f7a1127-b3b9-43ab-a9d1-d4eea5f6bffb tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:45.129746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2f7a1127-b3b9-43ab-a9d1-d4eea5f6bffb tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.150526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2f7a1127-b3b9-43ab-a9d1-d4eea5f6bffb tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1218 microversion: 2.1 time: 0.406128 Apr 30 13:16:45.151507 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 299/596] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:44 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1218 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:45.164500 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:45.178035 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:45.211695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:45.212316 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:45.215167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:45.215731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:45.703521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.718341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4364c15b-36ac-4dad-9716-a4064fbd0574 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 1.079017 Apr 30 13:16:45.729400 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 298/597] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:44 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:45.894211 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.909175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.912169 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.915799 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0ad8550d-a54c-454e-b84a-f42d0d550b9b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.762898 Apr 30 13:16:45.917155 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 300/598] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:45 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:46.170229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.170853 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:46.179671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.180394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.182511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.183238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.387824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:46.405723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d5c18950-93f4-40a2-b6fe-03499648fd37 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1222 microversion: 2.1 time: 0.240537 Apr 30 13:16:46.412252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 299/599] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:46.736249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.736844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:46.745269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.745746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.746553 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.746989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.937146 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.938018 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:46.960320 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.961278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.964044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.964807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:47.105116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.114279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bfb8e142-312d-4380-9e93-b0dfae5f8a04 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.381758 Apr 30 13:16:47.115880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 301/600] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:47.373994 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.392947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.395304 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.396647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d167bd8d-b0a8-4b7a-8074-1e37bf5cacbd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1406 microversion: 2.20 time: 0.465363 Apr 30 13:16:47.397900 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 300/601] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:16:47.431227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.432253 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:47.455187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:47.456295 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:47.457385 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:47.458086 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:47.591772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.601289 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dacfa694-d477-4296-9e23-fa9df2da0994 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1270 microversion: 2.1 time: 0.174944 Apr 30 13:16:47.602033 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 302/602] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:16:48.136941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.137818 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:48.153073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.154606 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.156665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.160067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.415671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.417918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:48.445991 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.447784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.450106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.454474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.620423 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:48.632680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e6b0ccf7-76c0-4cd9-b403-7c13b5f7c6e0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.503567 Apr 30 13:16:48.642717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 301/603] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:48.650463 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.655538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:48.674341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.676003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.677764 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:48.681733 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.900495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:48.918515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-95221d55-5663-4986-aa64-da4b0e3bd3a5 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1276 microversion: 2.1 time: 0.270140 Apr 30 13:16:48.921513 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 302/604] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:49.086996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:49.099435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:49.102106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:49.104251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a1bfb061-b541-4224-90ea-415b9d4964d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1598 microversion: 2.20 time: 0.692566 Apr 30 13:16:49.105106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 303/605] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1598 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:16:49.122042 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.122853 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:49.130459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.131142 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.132195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.132981 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.356322 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3fd63406-318a-4b61-8b0e-e4613f7ff5fc tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.238236 Apr 30 13:16:49.363179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 303/606] 10.222.0.69 () {60 vars in 1316 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:16:49.504843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-e401f3b3-7f3f-4260-9439-89e9026456e7 req-3d6152f6-0d8a-4f4f-b91f-5b39c4a19c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d187a24a-965f-4bdb-8ec9-e4ea19635718", "name": "network-vif-plugged", "status": "completed", "tag": "8abba6c9-b97f-4068-84b0-6fbd520ca4ba"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:49.506746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:49.506746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:16:49.526901 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e401f3b3-7f3f-4260-9439-89e9026456e7 req-3d6152f6-0d8a-4f4f-b91f-5b39c4a19c7c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.527808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e401f3b3-7f3f-4260-9439-89e9026456e7 req-3d6152f6-0d8a-4f4f-b91f-5b39c4a19c7c service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.562792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-e401f3b3-7f3f-4260-9439-89e9026456e7 req-3d6152f6-0d8a-4f4f-b91f-5b39c4a19c7c service nova] Creating event network-vif-plugged:8abba6c9-b97f-4068-84b0-6fbd520ca4ba for instance d187a24a-965f-4bdb-8ec9-e4ea19635718 on hv-cinder-78445 Apr 30 13:16:49.570808 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-e401f3b3-7f3f-4260-9439-89e9026456e7 req-3d6152f6-0d8a-4f4f-b91f-5b39c4a19c7c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071468 Apr 30 13:16:49.571986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 304/607] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:49.650223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.651135 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:49.660512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.661221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.662261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.662972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.941177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.944365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:49.954423 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.955145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.956783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.957484 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:50.420936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:50.436054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9f19c7e8-4e81-4f7e-b565-13dc2a121d17 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.789403 Apr 30 13:16:50.437255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 304/608] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:50.493945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:50.503384 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7217e1b7-78b0-4181-87a3-c8eb0d930513 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.568513 Apr 30 13:16:50.504750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 305/609] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:51.457607 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-6d6b059e-2118-4560-9aa1-8204987b1616 req-76fd5090-5dd0-4190-a29f-543ee08ee1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d6857c-a749-406c-91c7-ce3ab5448383", "tag": "f10a07e0-d07c-49de-8d6c-02b2ab3c5372"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:51.458242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:51.460153 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:51.461946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:51.461946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:51.483291 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.485624 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.486625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.487020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.493842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6d6b059e-2118-4560-9aa1-8204987b1616 req-76fd5090-5dd0-4190-a29f-543ee08ee1b4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.494400 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6d6b059e-2118-4560-9aa1-8204987b1616 req-76fd5090-5dd0-4190-a29f-543ee08ee1b4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.564083 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-6d6b059e-2118-4560-9aa1-8204987b1616 req-76fd5090-5dd0-4190-a29f-543ee08ee1b4 service nova] Creating event network-changed:f10a07e0-d07c-49de-8d6c-02b2ab3c5372 for instance 88d6857c-a749-406c-91c7-ce3ab5448383 on hv-cinder-78445 Apr 30 13:16:51.569851 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-6d6b059e-2118-4560-9aa1-8204987b1616 req-76fd5090-5dd0-4190-a29f-543ee08ee1b4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121940 Apr 30 13:16:51.586123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 305/610] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:51.591937 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:51.592906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:51.602167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.602863 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.604001 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.604596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:52.042283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:52.060442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-89667bca-44fe-4ea2-9586-bc32de33fcca tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1363 microversion: 2.1 time: 0.610872 Apr 30 13:16:52.061988 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 306/611] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:51 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1363 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:52.200810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:52.213407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9bfc3530-3483-4cb5-a0a0-02eddfa9562b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.625548 Apr 30 13:16:52.216533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 306/612] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:51 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:52.279771 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:52.280820 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:52.286158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-596441bf-0834-403e-9776-78b59480a3d4 req-fcaffa25-b72c-4114-aa74-f0cf5623634e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:52.288000 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:52.288000 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:52.307989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-596441bf-0834-403e-9776-78b59480a3d4 req-fcaffa25-b72c-4114-aa74-f0cf5623634e service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:52.308886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-596441bf-0834-403e-9776-78b59480a3d4 req-fcaffa25-b72c-4114-aa74-f0cf5623634e service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:52.310060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:52.310522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:52.313724 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:52.314183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:52.341046 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-596441bf-0834-403e-9776-78b59480a3d4 req-fcaffa25-b72c-4114-aa74-f0cf5623634e service nova] Creating event network-changed:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:16:52.347880 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-596441bf-0834-403e-9776-78b59480a3d4 req-fcaffa25-b72c-4114-aa74-f0cf5623634e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065490 Apr 30 13:16:52.351499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 307/613] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:52.498505 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dbb39cec-ae36-412c-b964-21e8e18d610e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.225245 Apr 30 13:16:52.502501 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 307/614] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:52 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:53.080209 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:53.081515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:53.102369 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:53.103105 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:53.104480 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:53.105700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:53.232640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:53.235125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:53.254878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:53.255593 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:53.256754 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:53.257431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.045783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:54.055292 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0fb3431c-4766-4f51-bd82-ccc127593998 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1549 microversion: 2.1 time: 0.979562 Apr 30 13:16:54.056217 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 308/615] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:53 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1549 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:54.064701 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:54.065680 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:54.093740 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.094819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.095801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.096396 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.243954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2661c543-b111-4be0-8d54-1c7106fe7e03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.182358 Apr 30 13:16:54.245487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 309/616] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:54 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:54.253634 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:54.262272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:54.285731 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.286472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.288166 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.288833 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.290652 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:54.319634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a24e8067-8698-48e4-9fd0-bc6893009a95 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 1.087152 Apr 30 13:16:54.320936 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 308/617] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:53 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:16:54.656132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a209873d-b8ee-46cb-8b4c-596419305c31 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.409045 Apr 30 13:16:54.665794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 310/618] 10.222.0.69 () {58 vars in 1275 bytes} [Fri Apr 30 13:16:54 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-interface => generated 284 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:55.256798 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:55.258514 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:55.268690 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:55.269429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:55.270795 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:55.272224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:55.337741 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:55.338412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:55.358599 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:55.358599 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:55.359784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:55.359784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:55.415641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-96c3eba9-b1be-41e2-9ea8-d9d5d7cf553a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.163154 Apr 30 13:16:55.419726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 309/619] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:55 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:55.646048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:55.666076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-415e607e-872a-4c7a-8864-0e66c7561db7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.333482 Apr 30 13:16:55.676368 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 311/620] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:55 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:56.684248 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:56.684860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:56.703815 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:56.704275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:56.705081 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:56.722818 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:56.821149 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:56.826165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:56.842872 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:56.843760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:56.844762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:56.845347 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.018007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1f00bbc7-5bb3-4eb8-9a80-a54143f3e3d1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.593410 Apr 30 13:16:57.018634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 310/621] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:56 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:57.025467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:57.026674 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:57.036613 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.037387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.038759 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.039411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.138735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:57.152522 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9af5211d-e3da-46cb-82f2-ad30e4cbd1d8 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.472147 Apr 30 13:16:57.168888 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 312/622] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:56 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:57.181058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fedfc1c3-9703-4b29-b4eb-2fdf85df4d07 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.160793 Apr 30 13:16:57.182179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 311/623] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:16:57 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:16:57.263399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-9e1da628-32b1-4874-a1ea-16f5bddb42ed req-d339a1e0-67d4-41b5-8f37-f3067dab3638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d187a24a-965f-4bdb-8ec9-e4ea19635718", "tag": "8abba6c9-b97f-4068-84b0-6fbd520ca4ba"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:57.266801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:16:57.266801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:16:57.278161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-9e1da628-32b1-4874-a1ea-16f5bddb42ed req-d339a1e0-67d4-41b5-8f37-f3067dab3638 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.278814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-9e1da628-32b1-4874-a1ea-16f5bddb42ed req-d339a1e0-67d4-41b5-8f37-f3067dab3638 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.320963 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-9e1da628-32b1-4874-a1ea-16f5bddb42ed req-d339a1e0-67d4-41b5-8f37-f3067dab3638 service nova] Creating event network-changed:8abba6c9-b97f-4068-84b0-6fbd520ca4ba for instance d187a24a-965f-4bdb-8ec9-e4ea19635718 on hv-cinder-78445 Apr 30 13:16:57.326993 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-9e1da628-32b1-4874-a1ea-16f5bddb42ed req-d339a1e0-67d4-41b5-8f37-f3067dab3638 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156388 Apr 30 13:16:57.327589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 313/624] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:58.028822 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:58.030418 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:58.039481 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.040254 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.041263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.041974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.176772 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:58.177437 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fcf05324-4b6b-46c8-8383-f2da03d3c253 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.152085 Apr 30 13:16:58.177676 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 312/625] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:58 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:58.179044 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:58.193478 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:58.194491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.194623 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:58.195541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.196594 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.197297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.210880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.223415 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.227309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:58.228772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:58.474625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-408c6d8e-7c56-43fa-980d-78dbe8ba60ab tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.285750 Apr 30 13:16:58.475929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 313/626] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:16:58 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:16:58.659417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:58.673437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ae566daf-61ef-410d-b9ce-2ad16fd6e4c1 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.501474 Apr 30 13:16:58.674085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 314/627] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:58 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:16:59.189205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:59.192592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:59.208429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.209173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.210224 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.211384 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.362078 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0136bf31-206d-4269-8ea1-402a215e5f1f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.177401 Apr 30 13:16:59.362726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 314/628] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:16:59 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:59.486481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:59.488038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:59.504140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.504872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.506035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.506999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.660462 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b2b4fe9c-7b77-4582-b426-f7bb5039c80f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.178081 Apr 30 13:16:59.662491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 315/629] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:16:59 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:16:59.692929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:59.693673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:59.707206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.707963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.708936 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.709580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.963892 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:59.976900 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9bb79d7a-a00a-4e9f-b805-9f4980934e77 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.289153 Apr 30 13:16:59.987193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 315/630] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:59 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:00.373312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:00.374436 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:00.383375 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:00.383828 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.384686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:00.385121 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.518575 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bc68fae7-152a-4302-b811-2cd55d550e27 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 14 microversion: 2.20 time: 0.149359 Apr 30 13:17:00.522535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 316/631] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:00 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:00.672477 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:00.674352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:00.685600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:00.686058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.687368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:00.687368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.836029 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6c7202b7-24ef-413d-821d-c1682f07a50e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.167443 Apr 30 13:17:00.837741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 316/632] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:00 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:17:00.908706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-bf995426-8a98-4971-a129-00fabeabc14c req-ee4eac3f-c2a7-4c08-8707-51a320909aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d6857c-a749-406c-91c7-ce3ab5448383", "name": "network-vif-plugged", "status": "completed", "tag": "f10a07e0-d07c-49de-8d6c-02b2ab3c5372"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:00.910416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:00.910416 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:17:00.922797 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bf995426-8a98-4971-a129-00fabeabc14c req-ee4eac3f-c2a7-4c08-8707-51a320909aa7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:00.923232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bf995426-8a98-4971-a129-00fabeabc14c req-ee4eac3f-c2a7-4c08-8707-51a320909aa7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.941985 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-bf995426-8a98-4971-a129-00fabeabc14c req-ee4eac3f-c2a7-4c08-8707-51a320909aa7 service nova] Creating event network-vif-plugged:f10a07e0-d07c-49de-8d6c-02b2ab3c5372 for instance 88d6857c-a749-406c-91c7-ce3ab5448383 on hv-cinder-78445 Apr 30 13:17:00.947185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-bf995426-8a98-4971-a129-00fabeabc14c req-ee4eac3f-c2a7-4c08-8707-51a320909aa7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043127 Apr 30 13:17:00.948286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 317/633] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:00.998139 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:00.999258 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:01.008981 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.009857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.010788 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.011337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.305191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:01.314924 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-40d0e064-922e-4f3e-8ccc-efc01a303138 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.324347 Apr 30 13:17:01.324408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 317/634] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:00 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:01.532911 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:01.534007 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:01.542239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.545233 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.546131 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.546582 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.754415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c9a4c13f-b70b-48ae-a83d-d7ce9292ec76 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 9443 microversion: 2.20 time: 0.228027 Apr 30 13:17:01.755388 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 318/635] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:01 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 9443 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:01.847284 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:01.848195 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:01.856797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.857243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.858048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.858743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.031660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f5ddaa18-7f60-4ece-b139-11bafca0a8de tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.187615 Apr 30 13:17:02.034894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 318/636] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:01 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:17:02.333150 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:02.333907 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:02.344029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.344484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.345291 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.345803 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.582810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:02.592515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-89de9ef9-fbad-44b9-93a3-8df4185124b7 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1318 microversion: 2.1 time: 0.263617 Apr 30 13:17:02.593419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 319/637] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:02 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:02.767090 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:02.768104 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:02.778252 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.778707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.779495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.779934 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.923083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a6718430-7ef2-441b-8793-9f1a7202e3d6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 15025 microversion: 2.20 time: 0.159481 Apr 30 13:17:02.929784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 319/638] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:02 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 15025 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:17:03.042876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:03.043798 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:03.053651 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.054498 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.055886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.056640 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.193563 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1bb9e0d5-f8b8-4307-b99d-8e20fb9d0823 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.154051 Apr 30 13:17:03.194652 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 320/639] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:03 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:17:03.610052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:03.610749 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:03.619579 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.620040 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.620840 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.621292 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.637523 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'create', calling method: .version_select at 0x7fe2fb4630d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-208257347"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:03.663881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for project 330522879a1442469115b6ce47db04cd. Resources: {'key_pairs'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:03.667838 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for user d6bc30d58aca43eebf159bfd3966bf34 and project 330522879a1442469115b6ce47db04cd. Resources: {'key_pairs'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:03.820810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for project 330522879a1442469115b6ce47db04cd. Resources: {'key_pairs'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:03.824832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for user d6bc30d58aca43eebf159bfd3966bf34 and project 330522879a1442469115b6ce47db04cd. Resources: {'key_pairs'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:03.826031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:03.834209 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c0ac04eb-55ac-4924-8dd7-c9176515fbe9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1507 microversion: 2.1 time: 0.228707 Apr 30 13:17:03.834843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 320/640] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:03 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:03.838678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ff41a46a-e4d6-4723-83f4-bcaaf77a2c8f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.205513 Apr 30 13:17:03.846096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 321/641] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Apr 30 13:17:03 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:03.851187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b52f89b6-0a58-4c1a-850f-e5b182b4b8a8", "device": "/dev/sdb"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:03.852240 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:03.859894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.860340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.861121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:03.861584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:03.896625 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-659004239", "imageRef": "07e56030-3c24-4ae7-be9b-fc9372739d06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-208257347", "networks": [{"uuid": "f94ec92d-da55-4a90-8bdf-4314b868efa4"}]}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:03.964550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] validate_networks() for [('f94ec92d-da55-4a90-8bdf-4314b868efa4', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:17:04.269806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ff04024d-66a0-413b-914c-59c7551240f6 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "POST /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422262 Apr 30 13:17:04.270431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 321/642] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:17:03 2021] POST /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:04.279185 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:04.280243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:04.289462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.290017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.290766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.291190 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.450976 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-56317c15-da55-4e5a-ad04-abf3e4647ba1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 18398 microversion: 2.20 time: 0.175985 Apr 30 13:17:04.451858 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 322/643] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:04 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 18398 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:04.457934 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:04.459183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:04.467687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.468123 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.469127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.469585 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.610165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-badb5299-ac89-409a-9b38-8adbc0c5ecb0 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 14 microversion: 2.1 time: 0.156126 Apr 30 13:17:04.610951 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 323/644] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:04 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:17:04.652871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:17:04.653405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:17:04.654062 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:17:04.654468 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:17:04.654873 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:17:04.665179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.665699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.666504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.666935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.685212 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for project 330522879a1442469115b6ce47db04cd. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:04.689820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Getting quotas for user d6bc30d58aca43eebf159bfd3966bf34 and project 330522879a1442469115b6ce47db04cd. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:04.701404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:17:04.703804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='07e56030-3c24-4ae7-be9b-fc9372739d06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:17:04.751866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fb48593a-1a35-449a-b4df-39276c50734b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859004 Apr 30 13:17:04.752512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 322/645] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:17:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:17:04.763449 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d7ff353c-9d7d-4668-8bee-6e4894605ebf tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:04.764279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d7ff353c-9d7d-4668-8bee-6e4894605ebf tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:04.846149 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d7ff353c-9d7d-4668-8bee-6e4894605ebf tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:04.855591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d7ff353c-9d7d-4668-8bee-6e4894605ebf tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1257 microversion: 2.1 time: 0.096471 Apr 30 13:17:04.856168 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 324/646] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:04 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1257 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:05.463075 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:05.464343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:05.484549 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.485123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.485906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.486341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.622062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:05.622990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:05.632174 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.632636 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.633464 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.633918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.638655 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8fa4c216-94bb-4390-8330-016dc2f1095e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 20675 microversion: 2.20 time: 0.179330 Apr 30 13:17:05.639303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 323/647] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:05 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 20675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:05.784279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-652a00c6-9431-4119-a455-fe89784d27f9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 8879 microversion: 2.1 time: 0.165847 Apr 30 13:17:05.784943 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 325/648] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:05 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 8879 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:05.874333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:05.875049 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:05.883497 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.884009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.884784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.885216 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.002968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:06.013484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-93050a62-28d5-452c-8d8d-a670f4a5b8a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1309 microversion: 2.1 time: 0.143143 Apr 30 13:17:06.013987 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 324/649] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:05 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:06.651302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:06.652722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:06.668913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.669364 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.670293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.670747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.796764 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:06.798038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:06.809651 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.817482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.818137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.818855 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.764879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-95443078-605d-4e43-9f0e-434534875c9d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28522 microversion: 2.20 time: 13.117510 Apr 30 13:17:19.765552 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 326/650] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:06 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28522 bytes in 13120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:17:19.771487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:19.772220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:19.781726 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.782272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.783053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.783490 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.831037 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8bb3bf41-a665-4a2d-b30a-5d43c2915c3f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28240 microversion: 2.1 time: 13.038193 Apr 30 13:17:19.835458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 325/651] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:06 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28240 bytes in 13041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:20.314128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:20.324338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8a33414c-e3e8-4655-aceb-fc74b5913868 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.557017 Apr 30 13:17:20.324979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 327/652] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:19 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:20.777172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:20.778288 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:20.787654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.788091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.789222 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.789881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.842855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:20.843779 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:20.871359 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.872508 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.875098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.875834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.957465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1e92c037-4be2-4426-83b1-ab462e46b2b7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28647 microversion: 2.20 time: 0.184405 Apr 30 13:17:20.961528 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 326/653] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:20 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28647 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:21.045758 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ec107280-b32a-477e-8558-6bcd30d7ee2b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28240 microversion: 2.1 time: 0.206597 Apr 30 13:17:21.047283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 328/654] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:20 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28240 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:21.060067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-33901958-37d0-444f-a339-89103c40e1ad req-c11a11fa-5349-47e9-8e9f-2925b6104bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:21.061785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:21.061785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:17:21.071174 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-33901958-37d0-444f-a339-89103c40e1ad req-c11a11fa-5349-47e9-8e9f-2925b6104bf3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.071909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-33901958-37d0-444f-a339-89103c40e1ad req-c11a11fa-5349-47e9-8e9f-2925b6104bf3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.092163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-33901958-37d0-444f-a339-89103c40e1ad req-c11a11fa-5349-47e9-8e9f-2925b6104bf3 service nova] Creating event network-changed:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:17:21.102082 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-33901958-37d0-444f-a339-89103c40e1ad req-c11a11fa-5349-47e9-8e9f-2925b6104bf3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122715 Apr 30 13:17:21.103312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 327/655] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:21.345647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:21.346468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:21.359814 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.360611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.362812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.363215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.744940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:21.753614 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5fc5ab3f-3ad1-47c5-9e68-f526423c48a8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.413240 Apr 30 13:17:21.754206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 329/656] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:21 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:21.970482 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:21.971717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:21.981418 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.981886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.982729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.983360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.059344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:22.060162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:22.068331 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.068782 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.069597 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.070029 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.148478 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-61a99377-a1c7-4b72-b3ac-02e74d46fda8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28240 microversion: 2.1 time: 3.092378 Apr 30 13:17:25.149333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 330/657] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:22 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28240 bytes in 3095 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:17:25.156895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:25.158037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:25.167076 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.167530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.168308 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.168778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.175272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6922723a-5f96-4595-92e7-0db25be14a1c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28689 microversion: 2.20 time: 3.208983 Apr 30 13:17:25.179252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 328/658] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:21 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28689 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:25.495044 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:25.503835 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-08936532-646a-4ed7-9f58-89d78d368a0e tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.353021 Apr 30 13:17:25.514384 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 331/659] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:25 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:26.163977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:26.164978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:26.173599 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:26.174413 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:26.175211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:26.175698 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:26.187401 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:26.188320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:26.196488 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:26.196927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:26.197741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:26.198201 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.068020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8de78b73-c4d0-4c06-a989-aacebedecc6f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28531 microversion: 2.1 time: 2.907715 Apr 30 13:17:29.068834 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 329/660] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:26 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28531 bytes in 2910 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:29.076437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:29.077148 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:29.084860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.085328 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.086486 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.086925 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.107525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0ffbe3a8-5f25-4270-9dd4-018fcbfdf278 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28689 microversion: 2.20 time: 2.923760 Apr 30 13:17:29.111631 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 332/661] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:26 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28689 bytes in 2926 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:29.292123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:29.301404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9dbe2a2c-e170-4aca-9e96-3f03faecd297 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.231247 Apr 30 13:17:29.302010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 330/662] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:29 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:30.080955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:30.082077 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:30.090334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.090940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.091756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.092207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.119643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:30.120573 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:30.128809 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.129257 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.130067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.130507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.262069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-88052c43-9d71-4dfe-b175-e2c8d535098d tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28532 microversion: 2.1 time: 0.184984 Apr 30 13:17:30.262641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 333/663] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:30 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28532 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:30.295260 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ab38e432-b786-4593-a1f9-8c4286a7f9c2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28689 microversion: 2.20 time: 0.178905 Apr 30 13:17:30.295935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 331/664] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:30 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:17:30.319242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:30.319986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:30.328366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.328826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.329631 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.330091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.532705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:30.542100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-18596282-b292-47b7-81dd-9f386ecacbf6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.227030 Apr 30 13:17:30.542679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 334/665] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:30 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:31.274030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:31.275581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:31.283200 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.283653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.284449 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.284882 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.330055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-1e5a7630-56dc-4211-939a-089878edd7e5 req-c3ffceec-7ca0-4e3c-8a9b-f5597dcdcf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "name": "network-vif-plugged", "status": "completed", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:31.332092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:31.332092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:17:31.341223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1e5a7630-56dc-4211-939a-089878edd7e5 req-c3ffceec-7ca0-4e3c-8a9b-f5597dcdcf23 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.342041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1e5a7630-56dc-4211-939a-089878edd7e5 req-c3ffceec-7ca0-4e3c-8a9b-f5597dcdcf23 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.358724 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-1e5a7630-56dc-4211-939a-089878edd7e5 req-c3ffceec-7ca0-4e3c-8a9b-f5597dcdcf23 service nova] Creating event network-vif-plugged:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:17:31.363206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-1e5a7630-56dc-4211-939a-089878edd7e5 req-c3ffceec-7ca0-4e3c-8a9b-f5597dcdcf23 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100393 Apr 30 13:17:31.363816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 332/666] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:31.369011 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:31.370026 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:31.377754 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.378204 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.378988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.379425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.451176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-49641c39-9aa7-4a66-aefc-04ea4801ef30 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.180680 Apr 30 13:17:31.451864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 335/667] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:31 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:17:31.545545 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e49bb0d1-5025-47c3-8fa2-458b0339ff44 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28689 microversion: 2.20 time: 0.180146 Apr 30 13:17:31.547090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 333/668] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:31 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:31.560035 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:31.560730 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:31.569517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.570065 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.570839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.571260 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.860913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:31.869516 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c4984394-7fb0-4776-bcf7-f5ebf5f8f7c5 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.313849 Apr 30 13:17:31.870097 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 336/669] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:31 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:32.464045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:32.465172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:32.473613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.474163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.475026 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.475526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.558020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:32.558828 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:32.567058 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.567506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.568287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.568718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.618129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e315ca05-4c13-4e0d-95bc-f25a5db71352 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.158116 Apr 30 13:17:32.619170 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 334/670] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:32 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:32.706972 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-47d7f4bc-1e7e-4bef-a15a-a843c42c65b5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 28689 microversion: 2.20 time: 0.152587 Apr 30 13:17:32.707615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 337/671] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:32 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 28689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:32.887345 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:32.888051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:32.896503 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.896965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.897801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.898240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.184556 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:33.193469 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bf5f90ce-6467-40d5-8a52-91df4734b28b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1357 microversion: 2.1 time: 0.310341 Apr 30 13:17:33.194229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 335/672] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:32 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1357 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:33.510233 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:33.510849 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:33.519154 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.519732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.520383 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.520804 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.631194 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:33.632105 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:33.640027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.640388 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.641205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.641681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.695652 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lazy-loading 'services' on Instance uuid 88d6857c-a749-406c-91c7-ce3ab5448383 {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:17:33.779996 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-61c81d32-7bb8-49a3-aea0-412fe8e2d402 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.152260 Apr 30 13:17:33.780760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 336/673] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:33 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:17:33.786500 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:33.787507 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:33.795782 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.796314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.797077 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.797785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.846123 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-aea697e9-3232-4861-8b0d-03f075611471 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "DELETE /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383/os-volume_attachments/b52f89b6-0a58-4c1a-850f-e5b182b4b8a8" status: 202 len: 0 microversion: 2.1 time: 0.340349 Apr 30 13:17:33.847040 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 338/674] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:17:33 2021] DELETE /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383/os-volume_attachments/b52f89b6-0a58-4c1a-850f-e5b182b4b8a8 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:33.971525 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c25d4728-12b0-4195-a9e4-4e174bc45d53 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 29271 microversion: 2.20 time: 0.188673 Apr 30 13:17:33.972667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 337/675] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:33 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 29271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:34.212965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:34.213717 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.221772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.222234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.223013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.223460 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.521093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.529959 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6b94b0fd-4cf5-4e55-9392-457f882b879a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1548 microversion: 2.1 time: 0.321282 Apr 30 13:17:34.530670 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 339/676] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1548 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:34.546567 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:34.547258 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.556051 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.556499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.557317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.557779 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.771757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.780727 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8cf2e5bc-668a-4ff6-a8c7-e30a94a78e48 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1548 microversion: 2.1 time: 0.238220 Apr 30 13:17:34.781499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 338/677] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1548 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:34.792193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:34.793484 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.796389 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:34.800080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:34.800080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:17:34.801107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.801854 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Searching by: {'deleted': False, 'project_id': '330522879a1442469115b6ce47db04cd'} {{(pid=87983) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 30 13:17:34.802438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.802880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.803806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.804249 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.807648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.808094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.808886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.809316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.898024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.multi_cell_list [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=87983) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Apr 30 13:17:34.942802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-db51e101-ea3c-4e0a-b404-822cf1be0136 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.154076 Apr 30 13:17:34.943479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 340/678] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:34 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:34.984985 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:34.986053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.992275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-db932b4d-0870-4665-8911-c7c358c46ff3 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199371 Apr 30 13:17:34.998777 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 339/679] 10.222.0.69 () {58 vars in 1125 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:34.998964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.998964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.998964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.998964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.003827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:35.004441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:35.012548 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.013009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.013805 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.014268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.146110 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8d194eee-b10d-437f-be80-e4789f2e0905 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 30844 microversion: 2.20 time: 0.165419 Apr 30 13:17:35.146783 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 341/680] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:34 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 30844 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:35.221744 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:35.230565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fe61f2fc-a26b-44fa-8ba8-a7f569a81b01 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1548 microversion: 2.1 time: 0.230502 Apr 30 13:17:35.231137 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 340/681] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:35.955735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:35.956823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:35.965708 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.966214 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.967060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.967493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.113316 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e88934fd-827f-432f-b177-9746a5a0ad11 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.161583 Apr 30 13:17:36.114037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 342/682] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:35 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:36.144659 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:36.145343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:36.153554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.154015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.154810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.155251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.161802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:36.163615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:36.176907 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.177658 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.178700 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.179568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.217771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:17:36.338557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f8161ddc-07bd-4da8-b4bf-54287f1bfc78 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 32610 microversion: 2.20 time: 0.182908 Apr 30 13:17:36.339502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 343/683] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:36 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 32610 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:36.354324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-cb40e693-3c23-4b7f-bd4d-b070fbf966f4 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "DELETE /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 204 len: 0 microversion: 2.1 time: 0.213111 Apr 30 13:17:36.355118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 341/684] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:17:36 2021] DELETE /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:17:36.364525 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:36.365324 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:36.374706 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.375187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.376028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.376425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.580234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:36.592356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7da0ac18-537f-491f-9f16-62215336f69c tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1513 microversion: 2.1 time: 0.232480 Apr 30 13:17:36.593051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 344/685] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:36 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:37.055076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40a12268-ac13-4266-8ce4-46b5a97ca2dd"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:37.056219 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:37.065209 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.065681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.066440 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.066869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.125797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:37.126935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:37.135908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.136382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.137153 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.137616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.290869 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2869aa53-024c-4061-8186-a3c74db14c97 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 28699 microversion: 2.1 time: 0.168555 Apr 30 13:17:37.291451 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 345/686] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:37 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 28699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:17:37.351047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:37.352186 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:37.360715 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.361692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.362036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.362388 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.506303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c411221f-75da-4389-bff3-f90f216c1097 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455104 Apr 30 13:17:37.507745 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 342/687] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:17:37 2021] POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:37.512141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-577bf3bb-165c-4e54-81b2-9b514bf93e09 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 33411 microversion: 2.20 time: 0.165042 Apr 30 13:17:37.512761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 346/688] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:37 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 33411 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:37.610451 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:37.611409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:37.619902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.620462 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.621363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.621884 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.830991 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:37.841050 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2bf959f0-55a3-4ec5-888d-96dede08ce0b tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1513 microversion: 2.1 time: 0.234669 Apr 30 13:17:37.841554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 343/689] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:37 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:38.303476 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:38.304607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:38.314466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.315151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.315963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.316564 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.504599 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5bed5a0c-93ed-4088-8fb5-575e54133777 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 29306 microversion: 2.1 time: 0.205580 Apr 30 13:17:38.505262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 347/690] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:38 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 29306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:38.524119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:38.525127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:38.533100 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.533619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.534403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.534843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.708589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f22ce2d-a1d2-4748-a16c-300427761dc7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 33780 microversion: 2.20 time: 0.188292 Apr 30 13:17:38.709261 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 344/691] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:38 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 33780 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:38.859740 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:38.860436 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:38.868805 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.869184 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.869988 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.870420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.211543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:39.220621 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2ec41a37-5dae-4675-afd9-2c346afa9388 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1513 microversion: 2.1 time: 0.365089 Apr 30 13:17:39.221227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 348/692] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:38 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:39.516933 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:39.517945 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:39.526141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.526771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.527344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.527776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.720557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:39.721517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:39.730134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.730640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.731581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.732022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.522890 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f69e49a9-00bb-4100-b23f-73c3b375609c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 30981 microversion: 2.1 time: 1.009789 Apr 30 13:17:40.523561 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 345/693] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:39 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 30981 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:40.528941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-73058739-8437-4e9b-92c7-283cb641cd15 req-3dd98d23-8366-412f-9fc8-2a544d2f0692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d6857c-a749-406c-91c7-ce3ab5448383", "name": "network-vif-deleted", "tag": "f10a07e0-d07c-49de-8d6c-02b2ab3c5372"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:40.530432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:40.530432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:17:40.539759 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-73058739-8437-4e9b-92c7-283cb641cd15 req-3dd98d23-8366-412f-9fc8-2a544d2f0692 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:40.540206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-73058739-8437-4e9b-92c7-283cb641cd15 req-3dd98d23-8366-412f-9fc8-2a544d2f0692 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.555334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-622a8a7e-bebe-4d0f-bfd7-8092bc4390e5 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 35471 microversion: 2.20 time: 0.838376 Apr 30 13:17:40.555995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 349/694] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:39 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 35471 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:40.558392 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-73058739-8437-4e9b-92c7-283cb641cd15 req-3dd98d23-8366-412f-9fc8-2a544d2f0692 service nova] Creating event network-vif-deleted:f10a07e0-d07c-49de-8d6c-02b2ab3c5372 for instance 88d6857c-a749-406c-91c7-ce3ab5448383 on hv-cinder-78445 Apr 30 13:17:40.561248 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:40.561975 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:40.563175 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-73058739-8437-4e9b-92c7-283cb641cd15 req-3dd98d23-8366-412f-9fc8-2a544d2f0692 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038145 Apr 30 13:17:40.563795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 346/695] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:40.570157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:40.570616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.571408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:40.571852 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.709611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e37e66ad414cbf92ef84bfab15339e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a5f6800c42410c8d7a418f920d9cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:40.718532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-76822d75-cf0f-45ee-8846-c554293ff222 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 200 len: 1303 microversion: 2.1 time: 0.161253 Apr 30 13:17:40.719239 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 350/696] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:40 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:41.535252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:41.536282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:41.544430 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.544893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.545708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.546176 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.567812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:41.568727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:41.576966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.577406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.578263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.578683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.718048 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7fe2eb97-e29d-4a3d-a3e6-e0309d321bfd tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 32237 microversion: 2.1 time: 0.186802 Apr 30 13:17:41.718794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 347/697] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:41 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 32237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:41.736073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:41.736787 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] [instance: 88d6857c-a749-406c-91c7-ce3ab5448383] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:41.745271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.745748 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.746528 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.746961 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.769660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-88f6abb3-e9f6-4668-afb8-b836647c31e1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 36618 microversion: 2.20 time: 0.205384 Apr 30 13:17:41.773727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 351/698] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:41 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 36618 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:41.802954 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] HTTP exception thrown: Instance 88d6857c-a749-406c-91c7-ce3ab5448383 could not be found. Apr 30 13:17:41.803564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] Returning 404 to user: Instance 88d6857c-a749-406c-91c7-ce3ab5448383 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:17:41.804398 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ed4f2017-7a9d-4a96-8080-b19903bf56b9 tempest-VolumesSnapshotTestJSON-830077845 tempest-VolumesSnapshotTestJSON-830077845-project] 10.222.0.69 "GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383" status: 404 len: 111 microversion: 2.1 time: 0.072419 Apr 30 13:17:41.804958 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 348/699] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:41 2021] GET /compute/v2.1/servers/88d6857c-a749-406c-91c7-ce3ab5448383 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:17:42.733801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:42.734993 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:42.745920 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.746367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.747144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.747582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.782095 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:42.782916 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:42.790860 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.791318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.792099 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.792567 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.889333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d841d221-39de-416c-b54b-a795a3d7dfe8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 33069 microversion: 2.1 time: 0.161963 Apr 30 13:17:42.890354 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 352/700] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:42 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 33069 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:43.073425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1850c440-9b1a-413b-b5b8-37c8f05dcee9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 37710 microversion: 2.20 time: 0.295056 Apr 30 13:17:43.074094 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 349/701] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:42 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 37710 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:17:43.902212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:43.903269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:43.911718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:43.912191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:43.912979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:43.913413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:44.086335 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:44.087381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:44.095502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:44.095982 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:44.096776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:44.097226 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.599475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2c5c3fcc-1eee-422e-a3d6-7b5aa15f0450 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 36139 microversion: 2.1 time: 2.700779 Apr 30 13:17:46.600160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 353/702] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:43 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 36139 bytes in 2703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:46.630167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bda30522-5dd3-4e79-92f3-d569cdc12d84 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 38240 microversion: 2.20 time: 2.547393 Apr 30 13:17:46.630818 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 350/703] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:44 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 38240 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:47.613073 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:47.614129 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:47.622490 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.622939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.623712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.624145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.645435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:47.646520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:47.656695 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.658554 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.659511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.660030 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.797957 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-42a58b8d-2d96-467e-bd57-29f86938c3ea tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 37061 microversion: 2.1 time: 0.188843 Apr 30 13:17:47.798679 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 354/704] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:47 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 37061 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:47.828437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4b49ee4d-1534-4224-b436-415705c03909 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 38314 microversion: 2.20 time: 0.187468 Apr 30 13:17:47.829238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 351/705] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:47 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 38314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:48.811114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:48.812198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:48.820051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.820504 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.821297 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.821768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.830047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:48.831107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:48.845232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.847205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.847787 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.848262 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.972502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e7711d0f-d85a-452a-9d4a-e859d30b847b tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 38219 microversion: 2.1 time: 0.165400 Apr 30 13:17:48.976677 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 355/706] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:48 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 38219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:48.978374 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:48.979424 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:48.987669 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.988126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.989151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.989620 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.056052 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:49.070267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e0cdf8da-0b61-4bca-b553-d36fc7e96aba tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1594 microversion: 2.1 time: 0.244150 Apr 30 13:17:49.071191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 352/707] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:48 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1594 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:49.120344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-0968c538-8b13-4e80-bccc-ba2aaea71b37 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 200 len: 38383 microversion: 2.20 time: 0.145620 Apr 30 13:17:49.120995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 356/708] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:48 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 38383 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:49.131056 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:49.131562 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:49.139499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.139947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.140724 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.141156 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.197239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-85c13ae5-3163-4cd4-b61b-f4de0ec09e65 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/ips" status: 200 len: 151 microversion: 2.20 time: 0.069859 Apr 30 13:17:49.198338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 353/709] 10.222.0.69 () {60 vars in 1289 bytes} [Fri Apr 30 13:17:49 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:17:49.985095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:49.986167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:49.994113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.994883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.995702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.996334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:50.128956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d3fb165e-d1f5-4537-b325-b09653bfe65f tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 38219 microversion: 2.1 time: 0.147958 Apr 30 13:17:50.129954 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 357/710] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:49 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 38219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:51.142988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:51.144327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:51.154966 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.155491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.156349 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.156902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.313320 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b3daffab-2ec7-41ce-b27b-0b175e1a7bcc tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action" status: 200 len: 38350 microversion: 2.1 time: 0.175119 Apr 30 13:17:51.319033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 354/711] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:51 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/action => generated 38350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:51.325227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:51.326118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:51.335459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.335914 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.336788 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.337228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.399589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7107cabe-8654-44bd-97ba-89752cdaffd9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/ips" status: 200 len: 145 microversion: 2.1 time: 0.078878 Apr 30 13:17:51.400176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 358/712] 10.222.0.69 () {58 vars in 1248 bytes} [Fri Apr 30 13:17:51 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:51.531332 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:51.532287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:51.540370 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.540833 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.541729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.542338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.606003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lazy-loading 'flavor' on Instance uuid d7a0389a-2b5b-4926-8b06-3478dbb798cd {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:17:51.809350 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-b61e0a3e-5343-41f2-a2a5-affbd413372e req-3bdeaae8-5a3b-405b-920b-df59960a4c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:51.812473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:51.812473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:17:51.839947 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-b61e0a3e-5343-41f2-a2a5-affbd413372e req-3bdeaae8-5a3b-405b-920b-df59960a4c95 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.840527 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-b61e0a3e-5343-41f2-a2a5-affbd413372e req-3bdeaae8-5a3b-405b-920b-df59960a4c95 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.879231 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-b61e0a3e-5343-41f2-a2a5-affbd413372e req-3bdeaae8-5a3b-405b-920b-df59960a4c95 service nova] Creating event network-changed:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:17:51.893841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-b61e0a3e-5343-41f2-a2a5-affbd413372e req-3bdeaae8-5a3b-405b-920b-df59960a4c95 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089969 Apr 30 13:17:51.895664 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 359/713] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:17:52.089888 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-808a8811-44e3-450d-9325-9abada62fcf0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 202 len: 0 microversion: 2.20 time: 0.562572 Apr 30 13:17:52.090817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 355/714] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:51 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:17:52.102052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:52.109956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:52.119616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.120696 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.122608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.123596 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.617714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:52.631790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:52.634383 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:52.636865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-450d7e6f-9646-4f24-9ed6-0af261c9044e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.541550 Apr 30 13:17:52.637853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 360/715] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:52 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:17:53.028656 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52750e43-689c-4896-8174-40f005ae9132"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:53.030714 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:53.040306 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.041077 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.042445 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.043041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.566272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-586848579"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:53.566909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:53.575487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.575939 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.576734 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.577173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.778673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.network.security_group_api [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Adding security group 72b23f7a-e9d6-47aa-b0a5-d8454ae7dd62 to port b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 Apr 30 13:17:54.312720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d8ac25dd-ef54-4fb4-a0a6-d7a29e6e26c9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action" status: 202 len: 0 microversion: 2.1 time: 0.751072 Apr 30 13:17:54.313478 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 361/716] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:53 2021] POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action => generated 0 bytes in 753 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:17:54.323561 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:54.324395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:54.332578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.333760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.334142 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.334578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.561052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:54.570784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:54.572283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:54.573608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1422a916-d49f-4755-b70e-bebee2f2d4fe tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.255424 Apr 30 13:17:54.574232 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 362/717] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:54 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:54.578587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:54.579412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:54.587793 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.588564 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.589357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.589822 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.802866 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:54.812256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-63c3d2dd-d140-4909-b442-15b762698008 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1640 microversion: 2.1 time: 0.236993 Apr 30 13:17:54.812825 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 363/718] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:54 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1640 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:54.817430 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-08a1ed05-29e7-47ea-aed3-a729cd7886e0 req-4bb689c0-f9c6-4fea-a46c-95e5af1319a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:54.819014 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:54.819014 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:17:54.827734 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-08a1ed05-29e7-47ea-aed3-a729cd7886e0 req-4bb689c0-f9c6-4fea-a46c-95e5af1319a7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.828205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-08a1ed05-29e7-47ea-aed3-a729cd7886e0 req-4bb689c0-f9c6-4fea-a46c-95e5af1319a7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.845731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-08a1ed05-29e7-47ea-aed3-a729cd7886e0 req-4bb689c0-f9c6-4fea-a46c-95e5af1319a7 service nova] Creating event network-changed:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:17:54.850573 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-08a1ed05-29e7-47ea-aed3-a729cd7886e0 req-4bb689c0-f9c6-4fea-a46c-95e5af1319a7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036616 Apr 30 13:17:54.851151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 364/719] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:55.595546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:55.596433 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:55.605666 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:55.606113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:55.607176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:55.607654 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:55.821063 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:55.829194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:55.830739 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:55.831878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c80a9c23-9cdf-4750-b9be-81c54f2c492c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.242613 Apr 30 13:17:55.832653 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 365/720] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:55 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:56.047326 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1669996a-e563-45ae-96a9-97cf4eb265f8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.023794 Apr 30 13:17:56.048479 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 356/721] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:17:53 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments => generated 194 bytes in 3026 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:56.850342 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:56.850990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:56.858924 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:56.859351 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:56.860100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:56.860580 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:57.074818 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:57.083971 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:57.085486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:57.086634 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c28660d7-1361-4aa5-82cb-dbcdf7785cd0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.240515 Apr 30 13:17:57.087207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 366/722] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:56 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:58.106473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:58.107225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:58.116289 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.116738 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.117560 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.117997 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.342916 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:58.351958 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:58.353579 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:58.354949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e594bc4c-b53c-4701-9f7c-7847044bf8d0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.253623 Apr 30 13:17:58.355543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 357/723] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:58 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:59.374372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:59.375064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:59.383827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.384261 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.385051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.385528 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.591255 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:59.604522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:59.606362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:59.607502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8e0d5048-cb34-4884-83be-eaa1d6dda799 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.237484 Apr 30 13:17:59.608056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 367/724] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:59 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:00.627881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:00.628685 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:00.640564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:00.641238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:00.642454 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:00.643029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:00.854815 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:00.867070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:00.869196 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:00.870946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-061a872a-8317-409a-bda8-f9d5fff75cd6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.247799 Apr 30 13:18:00.871657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 358/725] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:00 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:01.895510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:01.896202 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:01.904439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.904894 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.905720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.906162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.125326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:02.137630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:02.139428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:02.140545 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a31885c2-d336-4394-b979-18ad036dc63c tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.249006 Apr 30 13:18:02.141103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 368/726] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:01 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:03.169840 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:03.170489 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:03.180885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.181483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:03.182417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.182828 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:03.391535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:03.401343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:03.402855 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:03.404363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1c36fadd-d136-4d1a-8b7e-8c561487ec06 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.242581 Apr 30 13:18:03.404919 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 359/727] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:03 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:18:03.872972 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:03.874018 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:03.881937 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.882397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:03.883225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.883669 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:03.950841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c524b3ee-6188-4dac-93b7-150d0597d41e tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081685 Apr 30 13:18:03.951438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 369/728] 10.222.0.69 () {58 vars in 1302 bytes} [Fri Apr 30 13:18:03 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:03.964221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:03.964856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:03.976196 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.976822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:03.978207 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:03.978861 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:04.047176 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1cf2ccce-718e-41b7-929d-f655914840a2 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132" status: 200 len: 194 microversion: 2.1 time: 0.089144 Apr 30 13:18:04.047835 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 360/729] 10.222.0.69 () {58 vars in 1413 bytes} [Fri Apr 30 13:18:03 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132 => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:04.422611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:04.423194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:04.431365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:04.431821 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:04.432630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:04.433071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:04.645150 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:04.658606 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:04.660879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:04.662720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ce267e95-5243-4bfc-88a5-866850b26e56 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.243970 Apr 30 13:18:04.663523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 370/730] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:04 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:18:05.583737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7334eddf-9013-47e1-8cc0-4277534ecad9"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:05.584856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:05.593079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.593564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.594570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.595015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.682094 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:05.683161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:05.692554 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.693107 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.694020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.694561 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.910302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:05.919617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:05.921301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:05.923199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-aac43434-ef3d-4463-9b50-a9102083a735 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.245336 Apr 30 13:18:05.923498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 371/731] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:05 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:06.020619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5ecdf044-d728-4690-813c-1dc2a3e03fd4 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.441724 Apr 30 13:18:06.021151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 361/732] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:18:05 2021] POST /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:06.941499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:06.942126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:06.950830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.951298 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:06.952241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.952562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.182049 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:07.192207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:07.193648 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:07.195001 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dc60b07f-8c8b-409c-aa6c-4da2c4401580 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.257749 Apr 30 13:18:07.195582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 372/733] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:06 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:08.215779 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:08.216484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:08.225268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.225766 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.226590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.227032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.711804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:08.721360 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:08.722891 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:08.724039 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8f78647d-69cd-4bc8-a190-2e867fb945c6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1743 microversion: 2.20 time: 0.513171 Apr 30 13:18:08.724583 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 362/734] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:08 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1743 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:09.742406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:09.743013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:09.751175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:09.751602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:09.752664 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:09.752837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:09.982611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:09.994644 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:09.996886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:09.998398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5e4d169a-84b2-4b5c-88c9-3d1a596e0aec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1743 microversion: 2.20 time: 0.259753 Apr 30 13:18:09.999745 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 373/735] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:09 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:11.019903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:11.020534 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:11.029546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.030169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.031277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.031879 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.313466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:11.326177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:11.329948 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:11.332353 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0f6a93ab-30c3-43d7-a5a5-f65b3f50c041 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.316883 Apr 30 13:18:11.334072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 363/736] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:11 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:12.207691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-ef912591-7402-4690-a6b0-d4012ec7bb9d req-1812bfce-f03e-4d5d-9b85-823931fd303a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "name": "network-vif-plugged", "status": "completed", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:12.210088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:12.210088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:18:12.222402 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-ef912591-7402-4690-a6b0-d4012ec7bb9d req-1812bfce-f03e-4d5d-9b85-823931fd303a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.223293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-ef912591-7402-4690-a6b0-d4012ec7bb9d req-1812bfce-f03e-4d5d-9b85-823931fd303a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.241911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-ef912591-7402-4690-a6b0-d4012ec7bb9d req-1812bfce-f03e-4d5d-9b85-823931fd303a service nova] Creating event network-vif-plugged:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:18:12.247344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-ef912591-7402-4690-a6b0-d4012ec7bb9d req-1812bfce-f03e-4d5d-9b85-823931fd303a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045537 Apr 30 13:18:12.248680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 374/737] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:12.358614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:12.359780 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:12.368441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.369700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.370746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.372374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.692347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:12.705179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:12.708249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:12.709455 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d6f7fbef-20a2-48f9-8592-00741a21a1a9 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.361723 Apr 30 13:18:12.710520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 364/738] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:12 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:13.729061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:13.730498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:13.739256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.739993 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.740978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.741615 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.944572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:13.946248 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:13.953980 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.954706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.955681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.959286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:13.963634 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.970128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:13.972083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:13.973394 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dc0a6404-e7df-495c-a84d-7a5bd20eb027 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.248806 Apr 30 13:18:13.984940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 375/739] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:13 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:18:14.044381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f19ee1e8-ce53-452e-98d7-394b552da15c tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.103557 Apr 30 13:18:14.045030 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 365/740] 10.222.0.69 () {58 vars in 1302 bytes} [Fri Apr 30 13:18:13 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:14.991911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:14.992746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:15.000807 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.001362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.002318 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.002764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.345116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:15.356398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:15.358674 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:15.360502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-117503d0-f7e2-4b0e-b9b0-62fb3844631d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.372451 Apr 30 13:18:15.361618 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 376/741] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:14 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:18:16.387307 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:16.388105 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:16.399705 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.400613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.401867 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.402312 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.635106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:16.644981 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:16.646800 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:16.648009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b4cbc845-5f50-4b50-884b-39c9f52b3f61 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.265859 Apr 30 13:18:16.659351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 366/742] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:16 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:17.457446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:17.459199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.467349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.468188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.469273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.470012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.624595 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-256f6aef-af33-47e9-8bd9-f5c9e41f0c52 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action" status: 202 len: 0 microversion: 2.1 time: 0.170972 Apr 30 13:18:17.628814 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 377/743] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:18:17 2021] POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:17.640671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:17.641352 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.652277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.652971 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.654010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.655319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.668183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:17.668913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.678640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.679074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.679909 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.680387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.305198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.313920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.317609 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.319439 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.320784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-cd9211ca-726f-4071-a18d-10ff08fedc03 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.657437 Apr 30 13:18:18.321730 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 378/744] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:17 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:18:18.334692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9cf0fc8d-1d67-4950-83ca-a87c9b0ef61f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1751 microversion: 2.1 time: 0.702414 Apr 30 13:18:18.335619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 367/745] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:17 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1751 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:19.340457 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:19.341516 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:19.354950 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:19.356664 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:19.357318 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.360175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.362129 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.363875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.367490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.368566 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.369932 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.370700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.737208 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.751321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.752943 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.754198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a806acf2-6689-477c-972c-64df2b723279 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1738 microversion: 2.20 time: 0.418436 Apr 30 13:18:19.761116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.765435 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 379/746] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:19 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1738 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:19.772788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a8c632f4-7918-42c5-b0c6-ba6c79e924f8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.422571 Apr 30 13:18:19.774205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 368/747] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:19 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:20.772427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:20.773047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:20.780888 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.781362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.782171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.782600 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.791380 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:20.792047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:20.800737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.801352 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.802189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.802629 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.420387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.429266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.430706 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.432475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.433464 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-68567a8f-8152-43c2-9f37-5d5a2b98b624 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1720 microversion: 2.20 time: 0.664976 Apr 30 13:18:21.434764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 380/748] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:20 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1720 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:21.439504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c351f730-8114-4f18-a654-4a86190eb792 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.651666 Apr 30 13:18:21.446485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:21.447023 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:21.450032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 369/749] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:20 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:21.454732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.455146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.455916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.456348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.512876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lazy-loading 'flavor' on Instance uuid 99cbde8a-c152-4038-a60b-9efd8cd55037 {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:21.658680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3c249a01-b184-419e-9ebd-df90baa9c3ce tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "POST /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037/action" status: 202 len: 0 microversion: 2.1 time: 0.223382 Apr 30 13:18:21.659332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 381/750] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:18:21 2021] POST /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:21.669399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:21.670071 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:21.679669 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.680169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.681217 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.682231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.935792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.946790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6dd0548a-0d58-46b4-839e-a81ce77175d0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.282501 Apr 30 13:18:21.947373 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 370/751] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:21 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:22.453074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:22.453996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.456116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:22.456737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.462462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.462929 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.463817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.464336 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.464464 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.464865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.465693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.466267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.756380 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.760805 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.765831 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2e558ed1-4b2c-4921-8bcd-676470fd45e8 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.313565 Apr 30 13:18:22.766643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 371/752] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:22 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:22.769895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.771395 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.772521 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8774e472-1c0c-462e-8b17-75828c14aeec tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1720 microversion: 2.20 time: 0.323888 Apr 30 13:18:22.773064 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 382/753] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:22 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1720 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:22.965059 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:22.965762 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.973813 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.974268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.975034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.975460 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.182760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:23.191798 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f4bcba06-16bf-434d-ba3e-5385a604e669 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.230488 Apr 30 13:18:23.192383 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 372/754] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:22 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:23.783784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:23.784353 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:23.791904 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:23.792141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.792575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.792867 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:23.793357 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.793854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.804710 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.805510 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.806633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.807082 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.100542 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.108148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.110316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.111856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.113020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e7549d83-cf81-4514-b55f-b1fd405dfac0 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1720 microversion: 2.20 time: 0.326431 Apr 30 13:18:24.113655 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 373/755] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:23 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:24.118651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-338797af-6834-44d0-8653-df57fb0aed20 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.338636 Apr 30 13:18:24.119327 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 383/756] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:23 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:24.212195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:24.213038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:24.224913 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.225408 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.226212 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.226650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.442920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.452901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-aa1fc9bb-97ae-49f9-93c0-de5f3b1e2a1d tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.246594 Apr 30 13:18:24.453985 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 374/757] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:24 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:25.131945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:25.132609 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.135408 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:25.136034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.140760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.141213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.142045 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.142472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.143675 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.144132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.145021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.145350 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.445907 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.455023 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.455393 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.456976 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.458403 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c5cec37f-2914-43a3-a9eb-bc637d6c5aa2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1663 microversion: 2.20 time: 0.330508 Apr 30 13:18:25.459271 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 384/758] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:25 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:25.465890 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8b6a8743-1e1e-4baa-9f97-da36a70fc03d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.333872 Apr 30 13:18:25.466689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 375/759] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:25 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:25.474145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:25.475173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.478696 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd74800c-c8ba-42eb-97eb-ffe90dc36714"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:25.479921 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.484108 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.484569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.485349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.485821 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.487515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.487962 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.488886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.489334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.799475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.808177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bb9c41e8-9438-43b2-865e-ad557f0be6f0 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.340031 Apr 30 13:18:25.808762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 385/760] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:25 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:25.945816 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7c0e1906-cd8d-4c9c-840d-ca22700ac087 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.471258 Apr 30 13:18:25.946551 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 376/761] 10.222.0.69 () {62 vars in 1364 bytes} [Fri Apr 30 13:18:25 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-volume_attachments => generated 188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:18:26.059039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:26.059877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.067559 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.067988 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.068807 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.069239 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.088040 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-1694790c-92a6-46a6-844c-8cdff86617b2 req-5ec14af6-3b79-49e6-be38-a6b68ce613c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "name": "network-vif-unplugged", "status": "completed", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:26.090025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:26.090025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:18:26.103082 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1694790c-92a6-46a6-844c-8cdff86617b2 req-5ec14af6-3b79-49e6-be38-a6b68ce613c0 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.103738 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1694790c-92a6-46a6-844c-8cdff86617b2 req-5ec14af6-3b79-49e6-be38-a6b68ce613c0 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.121821 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.compute.server_external_events [req-1694790c-92a6-46a6-844c-8cdff86617b2 req-5ec14af6-3b79-49e6-be38-a6b68ce613c0 service nova] Unable to find a host for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd. Dropping event network-vif-unplugged {{(pid=87983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 30 13:18:26.123031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-1694790c-92a6-46a6-844c-8cdff86617b2 req-5ec14af6-3b79-49e6-be38-a6b68ce613c0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039530 Apr 30 13:18:26.123697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 377/762] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 30 13:18:26.483596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:26.484267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.492480 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.493135 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.494068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.494603 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.500967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c8b5b54b-4b55-4000-a4c5-4d374bf28c38 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-volume_attachments/bd74800c-c8ba-42eb-97eb-ffe90dc36714" status: 202 len: 0 microversion: 2.20 time: 0.445611 Apr 30 13:18:26.501702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 386/763] 10.222.0.69 () {60 vars in 1457 bytes} [Fri Apr 30 13:18:26 2021] DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/os-volume_attachments/bd74800c-c8ba-42eb-97eb-ffe90dc36714 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:18:26.606457 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:26.607037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.614480 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.614944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.615735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.616225 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.708731 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:26.718172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c0e0784a-a71d-4373-a177-08e06f597e24 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.238465 Apr 30 13:18:26.718506 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 378/764] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:26 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:26.767177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-76dd6942-d9be-49cd-a170-89a684a10ea6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action" status: 202 len: 0 microversion: 2.20 time: 0.164698 Apr 30 13:18:26.767794 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 387/765] 10.222.0.69 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:26 2021] POST /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:18:26.776461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:26.777083 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.785504 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.785964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.786775 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.787217 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.826129 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:26.827144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.835555 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.836156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.836963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.837444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.113068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:27.118432 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:27.127239 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fa23cefb-8624-4184-b51f-f2339bdcc4f2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.305065 Apr 30 13:18:27.127982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 388/766] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:26 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:27.130637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:27.132405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:27.133760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b88e8eb3-918b-4661-9bd5-98803d66f90f tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1671 microversion: 2.20 time: 0.361408 Apr 30 13:18:27.134407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 379/767] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:26 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1671 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:27.736871 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:27.737483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:27.745959 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.746456 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.747230 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.747665 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.018132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.030637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c83ad2ee-d7f5-4170-941f-233e157e923a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.297673 Apr 30 13:18:28.031370 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 389/768] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:27 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:28.147802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:28.148525 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:28.152019 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:28.152714 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:28.157679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.157679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.158530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.159060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.161419 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.161989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.162755 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.163382 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.633705 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.645186 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.650755 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.652366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.653574 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9200bfbc-5cfd-4320-a3aa-a1e79ac3a77b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1673 microversion: 2.20 time: 0.505420 Apr 30 13:18:28.654137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 390/769] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:28 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1673 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:28.654269 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b664d26f-6fa4-451e-a298-05d07b9fc0d1 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.510821 Apr 30 13:18:28.654801 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 380/770] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:28 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:29.053277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:29.053934 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.062428 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.063022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.063753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.064128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.358523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.371500 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-13b1bcb2-9073-4380-aa78-37dc15ad2b7f tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1756 microversion: 2.1 time: 0.323941 Apr 30 13:18:29.372233 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 391/771] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:29 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1756 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:29.676145 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:29.676792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:29.676903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.677017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.686231 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.686559 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.686687 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.686887 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.687563 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.687711 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.688070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.688275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.985510 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.996043 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.996230 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.997925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.999386 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5f9ee957-c3b2-41d2-a7ab-82013ca756d7 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.327570 Apr 30 13:18:30.000146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 392/772] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:29 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:30.005613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5287af1a-b118-4ac2-8e95-4fcab7807c7f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.333643 Apr 30 13:18:30.006233 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 381/773] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:29 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:30.014105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:30.014592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:30.022973 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.023499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.024278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.024713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.092587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c6797d51-23b8-49f6-ab37-28a618fd7d7a tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132" status: 200 len: 194 microversion: 2.1 time: 0.082138 Apr 30 13:18:30.093304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 393/774] 10.222.0.69 () {58 vars in 1413 bytes} [Fri Apr 30 13:18:30 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:30.103490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:30.103977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:30.111305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.113057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.113903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.114369 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.288406 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lazy-loading 'services' on Instance uuid d187a24a-965f-4bdb-8ec9-e4ea19635718 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:30.389762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:30.390373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:30.398567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.399038 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.399829 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.400420 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.437027 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0d81a698-5d5b-4f07-8daf-a13d3f95cb80 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132" status: 202 len: 0 microversion: 2.1 time: 0.337026 Apr 30 13:18:30.438318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 382/775] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:18:30 2021] DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/52750e43-689c-4896-8174-40f005ae9132 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:30.657608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:30.667272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e0728155-da4d-4125-b403-19eb1fba1b50 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1759 microversion: 2.1 time: 0.281217 Apr 30 13:18:30.667943 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 394/776] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:30 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1759 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:31.018936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:31.019535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:31.026141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:31.026762 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:31.027654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.028118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.028910 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.029361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.034323 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.034775 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.035566 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.036009 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.278627 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.288998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.290909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.292299 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4f1299bf-c060-4d24-814e-bebd09c0ae7a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.277742 Apr 30 13:18:31.295763 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 383/777] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:31 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:31.422685 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.432153 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e190e54c-5cbe-41d5-8b63-a276eedbbd43 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.409638 Apr 30 13:18:31.432760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 395/778] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:31 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:32.311764 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:32.312745 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:32.320843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.321299 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.322158 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.322595 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.455884 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:32.456531 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:32.464321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.464777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.465864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.466640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.598380 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:32.608443 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:32.610153 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:32.611329 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f40f9646-095e-4a65-a5c2-01b797284f60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.303490 Apr 30 13:18:32.611912 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 384/779] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:32 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:32.696264 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:32.705294 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e652e013-45eb-44f7-8152-165deb19f7f7 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.257371 Apr 30 13:18:32.705997 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 396/780] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:32 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:33.631063 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:33.631785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:33.639474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.639933 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.644078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.644078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.722421 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:33.723698 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:33.731727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.732530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.733562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.734184 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.938495 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.947785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.949266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.950494 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a370467a-1397-4820-b195-54c1195ae101 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.324213 Apr 30 13:18:33.950978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 385/781] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:33 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:34.001400 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:34.010307 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3dccd18a-8844-4f63-84a9-c131c12fa9e5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.291607 Apr 30 13:18:34.010886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 397/782] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:33 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:34.968375 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:34.969024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:34.977056 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.977550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.978488 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.978792 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.036816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:35.036816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:35.044389 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.044847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.045677 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.046091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.305526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.316632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.322041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.323235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6d7cfd69-a3a6-4c43-a775-4ad9ff091a6e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.358723 Apr 30 13:18:35.324062 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 386/783] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:34 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:35.325003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.334160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8b6820bf-9aac-438d-9bb2-6686d5538248 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.302650 Apr 30 13:18:35.343922 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 398/784] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:35 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:36.340865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:36.341565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:36.349308 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.349820 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.350610 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.350876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:36.351366 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.351490 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:36.360753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.361660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.362719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.363160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.669398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.678206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.680205 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-bcb3ad1b-d4d1-4bc8-b694-65eda2899291 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.332676 Apr 30 13:18:36.680831 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 399/785] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:36 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:36.687982 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.689569 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.690743 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6cd3da78-89df-414b-9038-19a03cb01677 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.353773 Apr 30 13:18:36.691309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 387/786] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:36 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:37.697280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:37.698124 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:37.708084 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:37.708811 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:37.715011 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.715456 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.716546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.717269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.719603 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.720067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.720888 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.721334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:38.018654 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.027737 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b83eb1a2-affe-4029-afcb-b5ae1dc06ad4 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.334404 Apr 30 13:18:38.033743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 400/787] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:37 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:38.042847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.052522 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.054073 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.055326 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e1462553-4ee0-47f8-9e20-ebc513d992ae tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.351054 Apr 30 13:18:38.055886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 388/788] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:37 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:39.047507 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:39.048715 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:39.059232 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.059891 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.060795 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.061228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.074642 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:39.076148 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:39.085388 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.086251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.087633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.088136 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.466101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.476442 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e1d5733b-daf0-426f-84b4-bb0a5aea131e tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.434856 Apr 30 13:18:39.487414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.488146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 401/789] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:39 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:39.496876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.498856 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.500319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bba0e15e-32f7-4724-8739-3c9f6e736a14 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.430278 Apr 30 13:18:39.501435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 389/790] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:39 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:40.494977 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:40.496211 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.508942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.510190 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.512482 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.513156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.519239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:40.520520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.529323 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.530122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.531201 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.531927 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.838132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:40.842607 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:40.847409 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4ff23862-52d5-4807-acb7-72867c2a2ad3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.356982 Apr 30 13:18:40.852750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:40.854007 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 402/791] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:40 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:40.854412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:40.855608 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-def7d5f4-1e06-4941-bc37-f15c348d7c87 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.340215 Apr 30 13:18:40.856159 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 390/792] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:40 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:41.866744 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:41.867732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.873935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:41.875396 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.883287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.884138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.885161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.885841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.901892 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.902352 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.903167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.903606 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.291541 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:42.300621 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-5c880af1-d429-4500-ad6c-9c075b272a4c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.437714 Apr 30 13:18:42.301466 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 403/793] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:41 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:42.313821 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:42.323377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:42.324880 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:42.326045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-54c254fd-fca3-47f2-8f02-95198b6759a6 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.455947 Apr 30 13:18:42.326809 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 391/794] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:41 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:42.775150 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:42.775853 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:42.786822 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.787518 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.788651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.789320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.855123 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f82a214a-1e0b-4191-8472-0621cfa61b06 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/7334eddf-9013-47e1-8cc0-4277534ecad9" status: 200 len: 194 microversion: 2.1 time: 0.085599 Apr 30 13:18:42.855778 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 404/795] 10.222.0.69 () {58 vars in 1413 bytes} [Fri Apr 30 13:18:42 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/7334eddf-9013-47e1-8cc0-4277534ecad9 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:42.871610 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:42.872332 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:42.883964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.884578 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.885263 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.885739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.050116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lazy-loading 'services' on Instance uuid d187a24a-965f-4bdb-8ec9-e4ea19635718 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:43.193038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c016cfa4-3934-4047-8019-931e4ea6bf54 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/7334eddf-9013-47e1-8cc0-4277534ecad9" status: 202 len: 0 microversion: 2.1 time: 0.327614 Apr 30 13:18:43.193765 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 392/796] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:18:42 2021] DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718/os-volume_attachments/7334eddf-9013-47e1-8cc0-4277534ecad9 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:43.318304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:43.318966 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:43.326291 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.326735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.327601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.328033 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.344626 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:43.345322 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:43.357415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.357889 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.358683 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.359129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.626117 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.634289 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.642482 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6c4d7f68-55e4-49ef-9d84-674f6ab9fdb9 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.328069 Apr 30 13:18:43.643413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 405/797] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:43 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:43.649868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.652908 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.655090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3ad2ee73-9909-4a05-90cc-f11aff2652f1 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.314309 Apr 30 13:18:43.656076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 393/798] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:43 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:44.667967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:44.668638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:44.675491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:44.677517 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.677978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.678811 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.679515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.680775 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:44.696824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.697188 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.697994 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.698433 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.061809 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.072062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3328f989-3c33-4b80-85c6-da826a46dd22 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 0.407548 Apr 30 13:18:45.072765 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 406/799] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:44 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:45.077582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:45.078234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:45.086041 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.086492 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.087275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.087708 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.091769 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.101448 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.103024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.104206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3cd2b822-867b-4652-a3a5-8673bd273e7e tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.433052 Apr 30 13:18:45.105021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 394/800] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:44 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:45.157215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:18:45.281443 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ceb6db55-d3b4-40a3-8c31-f8151f545bd8 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 204 len: 0 microversion: 2.1 time: 0.206990 Apr 30 13:18:45.281949 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 407/801] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:18:45 2021] DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:18:45.290189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:45.290803 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:45.298574 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.299023 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.299890 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.300265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.503753 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.514286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-409e0b4c-3b5b-407d-b95a-9981fa5e0d34 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1673 microversion: 2.1 time: 0.227609 Apr 30 13:18:45.514889 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 395/802] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:45 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:46.091635 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.092387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.099940 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.100383 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.101164 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.101638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.123148 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.123721 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.131394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.131847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.132637 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.133069 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.402361 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.412904 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.417506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-05b7d5fc-1809-4c2d-bfea-0e750804e223 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1509 microversion: 2.1 time: 0.331027 Apr 30 13:18:46.418337 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 408/803] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1509 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:46.425260 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-53316a5d-612e-47ae-853c-aea7171c639c req-af5b2cc3-08cd-42cd-9fd5-f99c875ad2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "name": "network-vif-plugged", "status": "completed", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:46.427723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:46.427723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:18:46.430341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.432203 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.433463 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-49256ac5-3817-4d71-94fd-a10cd93b7546 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.314708 Apr 30 13:18:46.434234 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 396/804] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:46.439280 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:46.440064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.447511 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-53316a5d-612e-47ae-853c-aea7171c639c req-af5b2cc3-08cd-42cd-9fd5-f99c875ad2ed service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.447965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-53316a5d-612e-47ae-853c-aea7171c639c req-af5b2cc3-08cd-42cd-9fd5-f99c875ad2ed service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.448410 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.449016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.450014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.450639 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.465387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-53316a5d-612e-47ae-853c-aea7171c639c req-af5b2cc3-08cd-42cd-9fd5-f99c875ad2ed service nova] Creating event network-vif-plugged:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:18:46.470233 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-53316a5d-612e-47ae-853c-aea7171c639c req-af5b2cc3-08cd-42cd-9fd5-f99c875ad2ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050397 Apr 30 13:18:46.470886 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 409/805] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:46.537756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.538461 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.546408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.547066 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.547932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.548799 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.647623 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6cb239f7-deea-410d-83ba-ef8e4276d12f tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "POST /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037/action" status: 202 len: 0 microversion: 2.1 time: 0.212114 Apr 30 13:18:46.648552 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 397/806] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:18:46 2021] POST /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:46.656682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.657505 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.665420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.665881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.666673 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.667358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.863908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.872761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9424fae9-ebf7-4255-8a42-722d63684e44 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1673 microversion: 2.1 time: 0.339691 Apr 30 13:18:46.873536 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 410/807] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1673 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:46.953008 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.962085 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-74192cd7-8c69-4144-968a-348b99b661ad tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1517 microversion: 2.1 time: 0.309302 Apr 30 13:18:46.962677 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 398/808] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:47.452402 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:47.453180 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:47.461112 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.461718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.462610 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.463156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.674913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:47.683862 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:47.685391 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:47.686935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-33f5ef41-952a-4820-af71-11bdcd4d9ca2 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.238622 Apr 30 13:18:47.687494 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 411/809] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:47 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:47.890450 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:47.891018 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:47.898866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.899321 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.900107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.900547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.980259 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:47.980891 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:47.988467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.988915 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.989750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.990179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.152411 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:48.161796 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d066ec7c-5276-4447-bcc4-00f61c137bc7 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1673 microversion: 2.1 time: 0.275133 Apr 30 13:18:48.171343 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 399/810] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:47 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1673 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:48.231622 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:48.241029 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-07c21f5c-20c2-4591-8c54-c2394052baea tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1519 microversion: 2.1 time: 0.264617 Apr 30 13:18:48.241644 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 412/811] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:47 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:48.490147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-137f237e-d35a-40a7-a7e3-eb7a81b3acd5 req-8faeec3d-9f4f-424d-8d18-9cd724f620c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "name": "network-vif-unplugged", "status": "completed", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:48.492347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:48.492347 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:18:48.515147 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-137f237e-d35a-40a7-a7e3-eb7a81b3acd5 req-8faeec3d-9f4f-424d-8d18-9cd724f620c3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.515543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-137f237e-d35a-40a7-a7e3-eb7a81b3acd5 req-8faeec3d-9f4f-424d-8d18-9cd724f620c3 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.532564 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.compute.server_external_events [req-137f237e-d35a-40a7-a7e3-eb7a81b3acd5 req-8faeec3d-9f4f-424d-8d18-9cd724f620c3 service nova] Unable to find a host for instance 99cbde8a-c152-4038-a60b-9efd8cd55037. Dropping event network-vif-unplugged {{(pid=87983) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 30 13:18:48.533662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-137f237e-d35a-40a7-a7e3-eb7a81b3acd5 req-8faeec3d-9f4f-424d-8d18-9cd724f620c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048630 Apr 30 13:18:48.534193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 400/812] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:48 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 30 13:18:48.705671 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:48.706990 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:48.729028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.733360 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.734750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.734750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.105933 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.117384 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.119094 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.120367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-722274d9-b817-40af-8954-47a8c7d64c9a tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1729 microversion: 2.20 time: 0.419887 Apr 30 13:18:49.121003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 413/813] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:48 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1729 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:49.179263 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:49.179871 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:49.187878 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.188333 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.189437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.189878 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.259321 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:49.260344 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:49.268213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.268701 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.269632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.270176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.315037 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7079ac80265c4901a3193aa27a46c1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3daf98030a4f9983829bc893d1c2a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.328165 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-83a95f2e-ed47-4887-904c-a1a518e6d109 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 200 len: 1605 microversion: 2.1 time: 0.152480 Apr 30 13:18:49.330229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 401/814] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:49 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 1605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:49.551251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-661038b9-155e-4d2c-8cb8-890b9007c6f9 req-e2fbce47-e7a3-427a-8b41-6b3dfc2421ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d187a24a-965f-4bdb-8ec9-e4ea19635718", "name": "network-vif-deleted", "tag": "8abba6c9-b97f-4068-84b0-6fbd520ca4ba"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:49.553012 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:49.553012 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:18:49.563083 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-661038b9-155e-4d2c-8cb8-890b9007c6f9 req-e2fbce47-e7a3-427a-8b41-6b3dfc2421ed service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.563788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-661038b9-155e-4d2c-8cb8-890b9007c6f9 req-e2fbce47-e7a3-427a-8b41-6b3dfc2421ed service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.582207 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-661038b9-155e-4d2c-8cb8-890b9007c6f9 req-e2fbce47-e7a3-427a-8b41-6b3dfc2421ed service nova] Creating event network-vif-deleted:8abba6c9-b97f-4068-84b0-6fbd520ca4ba for instance d187a24a-965f-4bdb-8ec9-e4ea19635718 on hv-cinder-78445 Apr 30 13:18:49.589255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-661038b9-155e-4d2c-8cb8-890b9007c6f9 req-e2fbce47-e7a3-427a-8b41-6b3dfc2421ed service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Apr 30 13:18:49.590883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 402/815] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:49.668387 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.678406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-681e4456-c29f-42cd-bfc8-18331ed70ccc tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1519 microversion: 2.1 time: 0.422699 Apr 30 13:18:49.679589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 414/816] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:49 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1519 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:50.140687 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.141868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.154872 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.155294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.156115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.156544 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.349134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.350651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.360483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.361408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.362333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.362889 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.386079 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.399460 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.401458 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.403378 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1c5bd6c3-b8b1-4dc5-aeaf-50299a467e0b tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1716 microversion: 2.20 time: 0.266763 Apr 30 13:18:50.413429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 403/817] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1716 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:50.435743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. Apr 30 13:18:50.436397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:50.437254 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f339a671-a47b-4606-aabe-935473321907 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 404 len: 111 microversion: 2.1 time: 0.094136 Apr 30 13:18:50.438199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 415/818] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:50.446689 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d45704c2-42d6-4dfb-9e8f-deadfe4990d6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '.version_select at 0x7fe2fb335dc0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.465893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d45704c2-42d6-4dfb-9e8f-deadfe4990d6 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476636242" status: 202 len: 0 microversion: 2.1 time: 0.022835 Apr 30 13:18:50.466649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 404/819] 10.222.0.69 () {58 vars in 1218 bytes} [Fri Apr 30 13:18:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476636242 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:50.696839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.697498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.705806 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.706361 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.707234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.707837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.919146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.929020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6a1ac174-333e-4fb3-afdd-d37280712aed tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.235934 Apr 30 13:18:50.930108 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 416/820] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:51.950848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:51.951701 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:51.959277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.959737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:51.960510 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.961214 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:52.183423 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:52.192559 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1dccb3e8-5767-4783-9a73-81af16142463 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.249002 Apr 30 13:18:52.193118 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 405/821] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:51 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:53.210658 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.211754 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.220132 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.220590 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.221398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.221837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.442997 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:53.452052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6ef5fe5b-4e40-486b-b4f5-1c96bcdc3980 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.245525 Apr 30 13:18:53.452544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 417/822] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:53.972697 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.973394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.984831 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.985277 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.986080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.986519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.035570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. Apr 30 13:18:54.036057 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:54.036889 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-027abf91-9590-4258-ad05-18e809c157d9 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 404 len: 111 microversion: 2.1 time: 0.070422 Apr 30 13:18:54.037466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 406/823] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:18:53 2021] DELETE /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:54.050768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.051551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: d187a24a-965f-4bdb-8ec9-e4ea19635718] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.061194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.061780 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.062562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.063020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.112496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. Apr 30 13:18:54.113097 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance d187a24a-965f-4bdb-8ec9-e4ea19635718 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:54.113977 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b714a981-2332-4533-ad5c-56fdd5acb3d3 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718" status: 404 len: 111 microversion: 2.1 time: 0.069641 Apr 30 13:18:54.114544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 418/824] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:54 2021] GET /compute/v2.1/servers/d187a24a-965f-4bdb-8ec9-e4ea19635718 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:54.475570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.476173 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.485354 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.485774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.486576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.487013 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.709508 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:54.719958 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1b3eb504-2f14-49d0-9627-09f2d2fe4231 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.248607 Apr 30 13:18:54.720544 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 407/825] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:54 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:55.355838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.356338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.364234 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.364693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.365508 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.365944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.415956 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. Apr 30 13:18:55.416551 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:55.417397 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-546b6592-bc4f-4c0a-b519-0725437108f5 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 404 len: 111 microversion: 2.1 time: 0.065398 Apr 30 13:18:55.417961 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 419/826] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:18:55 2021] DELETE /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:55.426901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.427519 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] [instance: 9504e6a6-a9cf-4f1a-a169-eea54daf121c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.435433 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.435924 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.436725 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.437172 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.492883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] HTTP exception thrown: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. Apr 30 13:18:55.493530 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] Returning 404 to user: Instance 9504e6a6-a9cf-4f1a-a169-eea54daf121c could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:55.494379 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-636b3306-9883-40e7-bf9a-22f9d4a2ef39 tempest-AttachVolumeTestJSON-135981164 tempest-AttachVolumeTestJSON-135981164-project] 10.222.0.69 "GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c" status: 404 len: 111 microversion: 2.1 time: 0.071812 Apr 30 13:18:55.494925 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 408/827] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:55 2021] GET /compute/v2.1/servers/9504e6a6-a9cf-4f1a-a169-eea54daf121c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:55.741792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.742408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.750327 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.750775 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.751562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.751998 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.164429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:56.173728 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-aa16b61d-03b3-4f10-817c-a051c1ea789c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.435259 Apr 30 13:18:56.174311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 420/828] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:55 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:57.191538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:57.192817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:57.200830 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.201288 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:57.202107 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.202547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:57.646976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:57.655841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bfd67655-a973-491c-8460-e2612de622d5 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.467989 Apr 30 13:18:57.656439 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 409/829] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:57 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:58.674302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:58.674880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:58.682687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.683137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.683942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.684520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.978144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.987020 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3b678584-cd1f-4ac9-8b8f-20c4cd09ac0c tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.317557 Apr 30 13:18:58.987801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 421/830] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:58 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:00.004571 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:00.005796 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:00.013692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.014485 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.015824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.016470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.237575 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:00.246633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-034c1e7e-1209-4f6c-8aaa-25b314e37d37 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.245915 Apr 30 13:19:00.247178 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 410/831] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:59 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:01.264608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.265607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:01.273844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.274444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.275398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.275932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.548607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.557686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d9741d93-1569-4d34-9eed-3c828f49a206 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.297274 Apr 30 13:19:01.558689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 422/832] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:02.359000 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-81ca7c9a-bee4-4d5b-b458-30463e04a225 req-4d31c481-8d0a-4988-88be-bdeb716efeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "name": "network-vif-plugged", "status": "completed", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:02.360793 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:02.360793 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:02.371119 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-81ca7c9a-bee4-4d5b-b458-30463e04a225 req-4d31c481-8d0a-4988-88be-bdeb716efeda service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.371949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-81ca7c9a-bee4-4d5b-b458-30463e04a225 req-4d31c481-8d0a-4988-88be-bdeb716efeda service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.393529 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-81ca7c9a-bee4-4d5b-b458-30463e04a225 req-4d31c481-8d0a-4988-88be-bdeb716efeda service nova] Creating event network-vif-plugged:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:19:02.399072 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-81ca7c9a-bee4-4d5b-b458-30463e04a225 req-4d31c481-8d0a-4988-88be-bdeb716efeda service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044223 Apr 30 13:19:02.400275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 411/833] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:02.575322 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:02.575986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.584475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.584950 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.585835 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.586718 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.873827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.882880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a44c8734-d65f-4c51-bf1b-3744813410b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.311513 Apr 30 13:19:02.883568 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 423/834] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:02 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:03.901203 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:03.902389 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:03.913568 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.914124 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.914991 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.915517 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.227189 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:04.235887 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2ad1759d-56f3-4b40-a11b-b713f7ed8a78 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1575 microversion: 2.1 time: 0.339186 Apr 30 13:19:04.236566 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 412/835] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:03 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1575 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:04.767237 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-496204115", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "80f53de5-5259-4652-858e-b5c33566feb0"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:04.839690 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] validate_networks() for [('80f53de5-5259-4652-858e-b5c33566feb0', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:19:05.253822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:05.254363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:05.262459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.262917 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.263704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.264171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.404223 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:19:05.404719 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:19:05.405135 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:19:05.405589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:19:05.406025 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:19:05.415348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.415897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.416642 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.417088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.437152 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:19:05.441046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for user 7c2b47c937514fe881a9512043d199e9 and project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:19:05.453608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:19:05.456235 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:19:05.487852 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.497350 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bc84dabb-896f-49df-8aeb-56f3ca8d7ef2 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1562 microversion: 2.1 time: 0.247654 Apr 30 13:19:05.498102 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 413/836] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:05 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1562 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:05.510425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a0a0fc85-d612-4ab7-b657-fc30587532dd tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.867073 Apr 30 13:19:05.511667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 424/837] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:19:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:19:05.527597 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bd59fd9c-c314-4a38-aa13-b1d668a47583 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:05.528667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bd59fd9c-c314-4a38-aa13-b1d668a47583 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:05.601551 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bd59fd9c-c314-4a38-aa13-b1d668a47583 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.609557 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bd59fd9c-c314-4a38-aa13-b1d668a47583 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1217 microversion: 2.1 time: 0.086462 Apr 30 13:19:05.610840 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 414/838] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:05 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:06.517139 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-586848579"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:06.518077 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.525786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.526235 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.527039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.527576 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.627122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:06.629106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.637569 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.638267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.639237 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.639821 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.800980 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.810922 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52508fdf-5e65-40b8-af5c-b2d087c6384f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1277 microversion: 2.1 time: 0.187631 Apr 30 13:19:06.811496 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 415/839] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:06 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:06.911838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.network.security_group_api [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Removing security group 72b23f7a-e9d6-47aa-b0a5-d8454ae7dd62 from port b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 Apr 30 13:19:07.828374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.829256 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.844906 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.848947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.850192 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.850648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.859438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d2c1096d-8d05-4ec1-9f37-61adf203b136 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action" status: 202 len: 0 microversion: 2.1 time: 1.346512 Apr 30 13:19:07.865301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 425/840] 10.222.0.69 () {60 vars in 1278 bytes} [Fri Apr 30 13:19:06 2021] POST /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/action => generated 0 bytes in 1353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:19:07.884782 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-487ac2ee-3dc7-4d50-954c-6e701a21742f req-786a868f-75d2-47af-92ea-b30ed147415d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:07.888453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:07.888453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:19:07.902592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-487ac2ee-3dc7-4d50-954c-6e701a21742f req-786a868f-75d2-47af-92ea-b30ed147415d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.903906 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-487ac2ee-3dc7-4d50-954c-6e701a21742f req-786a868f-75d2-47af-92ea-b30ed147415d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.932105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-487ac2ee-3dc7-4d50-954c-6e701a21742f req-786a868f-75d2-47af-92ea-b30ed147415d service nova] Creating event network-changed:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:19:07.944578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-487ac2ee-3dc7-4d50-954c-6e701a21742f req-786a868f-75d2-47af-92ea-b30ed147415d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065460 Apr 30 13:19:07.946070 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 426/841] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:08.068551 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:08.080751 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f04ab63b-26a9-402b-9b7a-b54eb8e106cc tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1275 microversion: 2.1 time: 0.256230 Apr 30 13:19:08.093565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 416/842] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:09.099708 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:09.100411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.108792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.109240 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.110134 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.110558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.918326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.927616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-cad7ca9a-a6c8-4fb1-b96c-186d7d2fae13 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.832074 Apr 30 13:19:09.928963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 427/843] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:09 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:10.757795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-e6f80c8d-f687-403e-a4f9-23b7d366863d req-69ef93c5-1f75-4a9d-9360-8db39a8e5fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccecde33-e41a-46fc-9ee1-f0834326656f", "tag": "f4d680b6-708a-42f8-a62f-e54604d1aaed"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:10.759339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:10.759339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:10.768381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e6f80c8d-f687-403e-a4f9-23b7d366863d req-69ef93c5-1f75-4a9d-9360-8db39a8e5fd6 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.768817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-e6f80c8d-f687-403e-a4f9-23b7d366863d req-69ef93c5-1f75-4a9d-9360-8db39a8e5fd6 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.785682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-e6f80c8d-f687-403e-a4f9-23b7d366863d req-69ef93c5-1f75-4a9d-9360-8db39a8e5fd6 service nova] Creating event network-changed:f4d680b6-708a-42f8-a62f-e54604d1aaed for instance ccecde33-e41a-46fc-9ee1-f0834326656f on hv-cinder-78445 Apr 30 13:19:10.791046 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-e6f80c8d-f687-403e-a4f9-23b7d366863d req-69ef93c5-1f75-4a9d-9360-8db39a8e5fd6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037040 Apr 30 13:19:10.792163 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 417/844] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:10.945077 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:10.945729 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:10.955144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.955818 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.956614 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.957053 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.116735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:11.117620 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:11.126152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.126465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.127293 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.127807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.295266 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lazy-loading 'services' on Instance uuid 08a7f8b6-a516-48e7-9102-72f697ce80e2 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:11.386293 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.400284 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f0fd7972-6cce-4841-90bc-a194f90f12d9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.458718 Apr 30 13:19:11.402595 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 428/845] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:10 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:11.458544 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-aa5aab32-3211-4eb8-a0d2-81fe0706ded2 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments/40a12268-ac13-4266-8ce4-46b5a97ca2dd" status: 202 len: 0 microversion: 2.1 time: 0.345456 Apr 30 13:19:11.461452 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 418/846] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:19:11 2021] DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments/40a12268-ac13-4266-8ce4-46b5a97ca2dd => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:19:11.470971 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:11.471972 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:11.482590 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.483502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.484594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.485863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.575179 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6ecb67f2-320b-44da-8461-d4df883a709b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109377 Apr 30 13:19:11.577417 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 429/847] 10.222.0.69 () {58 vars in 1302 bytes} [Fri Apr 30 13:19:11 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:12.418576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.419363 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.428887 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.429745 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.430768 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.431286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.589074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.590955 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.601750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.602269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.603272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.603734 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.675976 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-28346367-a984-450c-a734-a124de7725f6 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090860 Apr 30 13:19:12.676906 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 430/848] 10.222.0.69 () {58 vars in 1302 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:19:12.688218 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.689982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.697547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.698013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.698339 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:12.698963 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.699414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.706955 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d6176683-f05e-4b0e-9231-c151173dcc18 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.292779 Apr 30 13:19:12.707534 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 419/849] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:12.842909 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-6b050cd0-a3a6-4ecd-8386-6c0a23affe82 req-5a55c8ec-7e01-4185-b016-abf919d948f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:12.844453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:12.844453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:12.853225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6b050cd0-a3a6-4ecd-8386-6c0a23affe82 req-5a55c8ec-7e01-4185-b016-abf919d948f8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.853702 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6b050cd0-a3a6-4ecd-8386-6c0a23affe82 req-5a55c8ec-7e01-4185-b016-abf919d948f8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.856792 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] HTTP exception thrown: Instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 is not attached to volume 40a12268-ac13-4266-8ce4-46b5a97ca2dd Apr 30 13:19:12.857416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Returning 404 to user: Instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 is not attached to volume 40a12268-ac13-4266-8ce4-46b5a97ca2dd {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:12.858260 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c24bc88d-efc2-4be3-b27e-661d76e0bb59 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments/40a12268-ac13-4266-8ce4-46b5a97ca2dd" status: 404 len: 154 microversion: 2.1 time: 0.174884 Apr 30 13:19:12.858826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 431/850] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:19:12 2021] DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2/os-volume_attachments/40a12268-ac13-4266-8ce4-46b5a97ca2dd => generated 154 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:12.870628 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-6b050cd0-a3a6-4ecd-8386-6c0a23affe82 req-5a55c8ec-7e01-4185-b016-abf919d948f8 service nova] Creating event network-changed:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:19:12.875365 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-6b050cd0-a3a6-4ecd-8386-6c0a23affe82 req-5a55c8ec-7e01-4185-b016-abf919d948f8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036054 Apr 30 13:19:12.875970 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 420/851] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:13.723923 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:13.724731 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:13.732462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:13.732904 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.733723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:13.734157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.941903 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.950491 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-85ad8253-53d9-489b-b20f-66aed1eb9ed0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.230471 Apr 30 13:19:13.951054 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 432/852] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:13 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:14.107300 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.107877 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.116123 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.116598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.117413 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.117841 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.178776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:19:14.300714 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e24994ef-8155-44bc-8cb9-a6765612440b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 204 len: 0 microversion: 2.1 time: 0.197152 Apr 30 13:19:14.302039 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 421/853] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:19:14 2021] DELETE /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:19:14.310372 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.310995 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.319237 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.319544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.320347 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.320790 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.579986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:14.588962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-20cd8e72-51c5-4ba1-9bfe-9da31ef8fe6b tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1554 microversion: 2.1 time: 0.282319 Apr 30 13:19:14.589558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 433/854] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:14 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:14.967845 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.968555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.976420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.976874 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.977693 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.978132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.180425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.189305 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7ba6c046-780b-4fd5-8a73-13b5323efc2e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.225540 Apr 30 13:19:15.189949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 422/855] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:14 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:15.606843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:15.607473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:15.615746 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.616128 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.616922 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.617360 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.820834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.829908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-751007bd-d2c6-47e3-a325-ae53d2cae04a tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1554 microversion: 2.1 time: 0.226689 Apr 30 13:19:15.830493 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 434/856] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:15 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1554 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:16.206576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:16.207210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:16.215550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.216002 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.216832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.217272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.441498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-cf913fc3-67e3-4044-92cd-95cad215a3d1 req-69b4928f-7f2c-4c52-a6f8-c3ddf6b9a4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccecde33-e41a-46fc-9ee1-f0834326656f", "name": "network-vif-plugged", "status": "completed", "tag": "f4d680b6-708a-42f8-a62f-e54604d1aaed"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:16.443408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:16.443408 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:19:16.455221 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-cf913fc3-67e3-4044-92cd-95cad215a3d1 req-69b4928f-7f2c-4c52-a6f8-c3ddf6b9a4aa service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.455897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-cf913fc3-67e3-4044-92cd-95cad215a3d1 req-69b4928f-7f2c-4c52-a6f8-c3ddf6b9a4aa service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.478926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-cf913fc3-67e3-4044-92cd-95cad215a3d1 req-69b4928f-7f2c-4c52-a6f8-c3ddf6b9a4aa service nova] Creating event network-vif-plugged:f4d680b6-708a-42f8-a62f-e54604d1aaed for instance ccecde33-e41a-46fc-9ee1-f0834326656f on hv-cinder-78445 Apr 30 13:19:16.484589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-cf913fc3-67e3-4044-92cd-95cad215a3d1 req-69b4928f-7f2c-4c52-a6f8-c3ddf6b9a4aa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047518 Apr 30 13:19:16.485284 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 435/857] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:16.493286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:16.504589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-aea0fc72-abc8-49d1-a5ca-949ea53aff87 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.301903 Apr 30 13:19:16.505418 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 423/858] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:16 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:16.848524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:16.849184 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:16.857172 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.857727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.858514 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.858925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:17.251774 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:17.262473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b01facb9-579c-41cf-8e92-2444bba898ab tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1554 microversion: 2.1 time: 0.418149 Apr 30 13:19:17.263055 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 436/859] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:16 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1554 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:17.402228 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-fb1da92e-0a4e-4fc1-b2c2-04b018fb5f05 req-7f30f30a-7f2e-495d-afba-b384e5f63a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08a7f8b6-a516-48e7-9102-72f697ce80e2", "name": "network-vif-deleted", "tag": "b1c0f6ee-3dd3-4d94-9dc0-4234936a6468"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:17.403740 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:17.403740 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:17.413309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fb1da92e-0a4e-4fc1-b2c2-04b018fb5f05 req-7f30f30a-7f2e-495d-afba-b384e5f63a6a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:17.413806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-fb1da92e-0a4e-4fc1-b2c2-04b018fb5f05 req-7f30f30a-7f2e-495d-afba-b384e5f63a6a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:17.434618 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-fb1da92e-0a4e-4fc1-b2c2-04b018fb5f05 req-7f30f30a-7f2e-495d-afba-b384e5f63a6a service nova] Creating event network-vif-deleted:b1c0f6ee-3dd3-4d94-9dc0-4234936a6468 for instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 on hv-cinder-78445 Apr 30 13:19:17.439700 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-fb1da92e-0a4e-4fc1-b2c2-04b018fb5f05 req-7f30f30a-7f2e-495d-afba-b384e5f63a6a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041303 Apr 30 13:19:17.440319 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 424/860] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:17.521444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:17.522146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:17.530089 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:17.530641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:17.531521 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:17.532074 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:17.743562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:17.752785 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a6f9e0f1-9b5d-4988-9c55-bc9e6b4dbc56 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1317 microversion: 2.1 time: 0.235155 Apr 30 13:19:17.753515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 437/861] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:17 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:18.286253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:18.288318 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:18.305905 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.306732 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.308284 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.309086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.436370 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.437025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.437025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lazy-loading 'fault' on Instance uuid 08a7f8b6-a516-48e7-9102-72f697ce80e2 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:18.520946 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6bc30d58aca43eebf159bfd3966bf34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330522879a1442469115b6ce47db04cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:18.529253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-10215221-612b-4ddc-82f0-2275fbb3886d tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 200 len: 1347 microversion: 2.1 time: 0.252550 Apr 30 13:19:18.529865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 425/862] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:18 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 1347 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:18.770145 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:18.770691 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:18.778523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.778974 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.779750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.780193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.993333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:19.002211 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ea8917e9-9cb6-4546-8b7d-e1152b010d39 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1507 microversion: 2.1 time: 0.236730 Apr 30 13:19:19.002779 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 438/863] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:18 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:19.546569 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:19.547224 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] [instance: 08a7f8b6-a516-48e7-9102-72f697ce80e2] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:19.555447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.555936 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.556786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.557295 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.606592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] HTTP exception thrown: Instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 could not be found. Apr 30 13:19:19.607179 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Returning 404 to user: Instance 08a7f8b6-a516-48e7-9102-72f697ce80e2 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:19.608042 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6f9b861b-e8c1-4bcf-a2ae-06f85e850813 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2" status: 404 len: 111 microversion: 2.1 time: 0.065322 Apr 30 13:19:19.608590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 426/864] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:19 2021] GET /compute/v2.1/servers/08a7f8b6-a516-48e7-9102-72f697ce80e2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:19.617139 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2f13ca31-aab7-4772-84af-cbd0c9600fa9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] Calling method '.version_select at 0x7fe2fae533a0>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:19.639725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2f13ca31-aab7-4772-84af-cbd0c9600fa9 tempest-TestMinimumBasicScenario-145990066 tempest-TestMinimumBasicScenario-145990066-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-208257347" status: 202 len: 0 microversion: 2.1 time: 0.026155 Apr 30 13:19:19.640527 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 439/865] 10.222.0.69 () {58 vars in 1269 bytes} [Fri Apr 30 13:19:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-208257347 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:19:20.595899 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ce5b41-5737-4ac0-a84c-26e731acf057"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:20.596998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:20.605177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.605732 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.606502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.606978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:21.059844 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-81d89f39-132d-4048-9f75-ca29f6912d1e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468843 Apr 30 13:19:21.060888 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 427/866] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:20 2021] POST /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:23.891127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:23.892737 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:23.900780 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.901302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.902758 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.903212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.982931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:19:24.164738 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2481e5f3-87c8-4d28-8233-90b2de4efc60 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 204 len: 0 microversion: 2.20 time: 0.276972 Apr 30 13:19:24.165779 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 440/867] 10.222.0.69 () {60 vars in 1280 bytes} [Fri Apr 30 13:19:23 2021] DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:19:24.178342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:24.178895 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:24.190569 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:24.191206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:24.192131 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:24.192646 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:24.457869 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.477020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.480335 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.482633 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c5b7a75f-a709-4a04-a2cf-d001edba44ce tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.310118 Apr 30 13:19:24.483688 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 428/868] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:24 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:25.518965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:25.521301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:25.538469 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.539736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.541582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.542713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.991711 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.008967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.012298 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.014539 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f91f8624-a9c6-4366-ba46-53e02c0a37ad tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.504876 Apr 30 13:19:26.015562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 441/869] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:25 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:27.034212 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:27.034824 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:27.042887 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.043336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.044122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.044546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.894412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:27.909316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:27.911410 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:27.914169 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7499da1f-8ac0-4c35-91e0-fcd587d0c257 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1722 microversion: 2.20 time: 0.883876 Apr 30 13:19:27.916600 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 429/870] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:27 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1722 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:28.594467 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-448bad2d-7e77-4d2a-a203-c9c4033c89fc req-87572b0f-ce3d-43d1-ab44-4c2baf3ee318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a0389a-2b5b-4926-8b06-3478dbb798cd", "name": "network-vif-deleted", "tag": "dde4074f-b16d-4a7b-bfc0-45a5b0b628d6"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:28.596959 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:28.596959 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:19:28.628275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-448bad2d-7e77-4d2a-a203-c9c4033c89fc req-87572b0f-ce3d-43d1-ab44-4c2baf3ee318 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.629026 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-448bad2d-7e77-4d2a-a203-c9c4033c89fc req-87572b0f-ce3d-43d1-ab44-4c2baf3ee318 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:28.662313 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-448bad2d-7e77-4d2a-a203-c9c4033c89fc req-87572b0f-ce3d-43d1-ab44-4c2baf3ee318 service nova] Creating event network-vif-deleted:dde4074f-b16d-4a7b-bfc0-45a5b0b628d6 for instance d7a0389a-2b5b-4926-8b06-3478dbb798cd on hv-cinder-78445 Apr 30 13:19:28.670693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-448bad2d-7e77-4d2a-a203-c9c4033c89fc req-87572b0f-ce3d-43d1-ab44-4c2baf3ee318 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080370 Apr 30 13:19:28.673582 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 442/871] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:28.933893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:28.935419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:28.945873 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.946791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:28.947800 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.948246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.023015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.023466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.023935 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lazy-loading 'fault' on Instance uuid d7a0389a-2b5b-4926-8b06-3478dbb798cd {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:29.131699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:29.141311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:29.144151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c38688227e014d68a4d5ff7f21f83168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a397097db8304460991aa7950d00f829', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:29.146539 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0e0de16e-d2f6-400a-a016-a60a4e7930f8 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 200 len: 1371 microversion: 2.20 time: 0.216642 Apr 30 13:19:29.147999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 430/872] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:28 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:29.279847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1797526632", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "80f53de5-5259-4652-858e-b5c33566feb0"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:29.372346 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] validate_networks() for [('80f53de5-5259-4652-858e-b5c33566feb0', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:19:29.986227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:19:29.986843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:19:29.987543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:19:29.987967 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:19:29.988581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:19:29.997574 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.998030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.998834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.999607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.020519 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:19:30.025902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for user 7c2b47c937514fe881a9512043d199e9 and project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:19:30.041876 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:19:30.044720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:19:30.105034 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2e4ed8b8-6c2f-4a97-8840-62a9d7f33fe3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829641 Apr 30 13:19:30.105727 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 443/873] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:19:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:19:30.117036 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7c121e67-13a6-41c8-8473-d29ea6464f97 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:30.117712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7c121e67-13a6-41c8-8473-d29ea6464f97 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:30.175198 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:30.175821 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:30.190526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.190976 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.191764 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.202238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.255055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7c121e67-13a6-41c8-8473-d29ea6464f97 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:30.274395 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7c121e67-13a6-41c8-8473-d29ea6464f97 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1218 microversion: 2.1 time: 0.160220 Apr 30 13:19:30.285345 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 431/874] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:30 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:30.289219 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. Apr 30 13:19:30.289735 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:30.298878 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b36b8250-2ad7-4476-811e-b3dc168344f3 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 404 len: 111 microversion: 2.20 time: 0.135232 Apr 30 13:19:30.302877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 444/875] 10.222.0.69 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:30 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 30 13:19:30.308157 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-491db208-8682-4195-81a6-0c7acc8562df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '.version_select at 0x7fe2fb43d430>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:30.338412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-491db208-8682-4195-81a6-0c7acc8562df tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134523763" status: 204 len: 0 microversion: 2.20 time: 0.034262 Apr 30 13:19:30.339619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 432/876] 10.222.0.69 () {60 vars in 1259 bytes} [Fri Apr 30 13:19:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134523763 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:19:31.292812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:31.294213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:31.306523 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.307655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.309062 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.310088 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.688204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:31.701359 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6d43f584-b014-44de-acb1-3a2adf5c43a9 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1270 microversion: 2.1 time: 0.412913 Apr 30 13:19:31.704212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 445/877] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:31 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1270 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:32.724949 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:32.726311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:32.735926 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.736854 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.737901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.738513 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.943636 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.952706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-36a8403a-d6d8-4644-843e-302edf1f054e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1276 microversion: 2.1 time: 0.234940 Apr 30 13:19:32.953281 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 433/878] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:32 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:33.613556 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.614148 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.621905 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.622603 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.623563 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.624163 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.685978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. Apr 30 13:19:33.687039 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:33.688190 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a71cf3ec-3461-4ec3-a7de-cf63d3328782 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 404 len: 111 microversion: 2.1 time: 0.078501 Apr 30 13:19:33.689311 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 446/879] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:19:33 2021] DELETE /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:33.698498 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.699718 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: d7a0389a-2b5b-4926-8b06-3478dbb798cd] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.710122 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.711222 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.712047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.712686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.780070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. Apr 30 13:19:33.782400 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance d7a0389a-2b5b-4926-8b06-3478dbb798cd could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:33.783745 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-340e6db0-9cfa-43ed-be7c-77414cd73cfd tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd" status: 404 len: 111 microversion: 2.1 time: 0.090389 Apr 30 13:19:33.784929 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 434/880] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:33 2021] GET /compute/v2.1/servers/d7a0389a-2b5b-4926-8b06-3478dbb798cd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:19:33.970675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.971371 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.982673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.983118 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.989175 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.990204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.536883 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:34.554309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d440b3b4-c659-4d1f-aa9c-33407a860274 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.586761 Apr 30 13:19:34.555526 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 447/881] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:33 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:34.632286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-1afb3ee6-e852-4113-b34e-18b342a67587 req-8b413d6f-f34b-4595-ade7-b2b2238a38cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1f86b9-d5f9-4c52-bdf6-be893bb1643c", "tag": "57af5644-3314-452d-aaab-c8e4f96b1121"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:34.634901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:34.634901 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:34.646613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1afb3ee6-e852-4113-b34e-18b342a67587 req-8b413d6f-f34b-4595-ade7-b2b2238a38cd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:34.647421 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-1afb3ee6-e852-4113-b34e-18b342a67587 req-8b413d6f-f34b-4595-ade7-b2b2238a38cd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.669466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-1afb3ee6-e852-4113-b34e-18b342a67587 req-8b413d6f-f34b-4595-ade7-b2b2238a38cd service nova] Creating event network-changed:57af5644-3314-452d-aaab-c8e4f96b1121 for instance ee1f86b9-d5f9-4c52-bdf6-be893bb1643c on hv-cinder-78445 Apr 30 13:19:34.675766 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-1afb3ee6-e852-4113-b34e-18b342a67587 req-8b413d6f-f34b-4595-ade7-b2b2238a38cd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051720 Apr 30 13:19:34.676781 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 435/882] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:35.170617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:35.171279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:35.180141 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.180680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.181845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.182547 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.236168 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. Apr 30 13:19:35.236922 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:35.237879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-325b3b19-524a-451b-a0db-9020375fe756 tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 404 len: 111 microversion: 2.1 time: 0.071169 Apr 30 13:19:35.238968 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 448/883] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:19:35 2021] DELETE /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:35.248031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:35.249340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] [instance: b4d095de-4619-4350-a486-c7238d32b916] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:35.258243 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.258883 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.259843 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.260671 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.318246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] HTTP exception thrown: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. Apr 30 13:19:35.319087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] Returning 404 to user: Instance b4d095de-4619-4350-a486-c7238d32b916 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:35.321245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0df88e4a-3cd9-4541-92ea-7f6f50e0495d tempest-AttachVolumeShelveTestJSON-902443585 tempest-AttachVolumeShelveTestJSON-902443585-project] 10.222.0.69 "GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916" status: 404 len: 111 microversion: 2.1 time: 0.076694 Apr 30 13:19:35.322041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 436/884] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:35 2021] GET /compute/v2.1/servers/b4d095de-4619-4350-a486-c7238d32b916 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:35.578472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:35.579509 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:35.592617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.595031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.596648 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.599380 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:36.046147 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:36.055688 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3c9eb6aa-78a5-46c4-90c8-5f5956a35935 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.480765 Apr 30 13:19:36.056446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 449/885] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:35 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:37.072509 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:37.073210 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:37.081188 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.081783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.082497 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.082905 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.310382 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:37.319795 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7480da3e-dace-46bf-b1d0-516123a7e8c5 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.251192 Apr 30 13:19:37.320448 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 437/886] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:37 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:38.341251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:38.342619 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:38.350666 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.351127 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.351926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.352416 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.638101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:38.648247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8631eaa9-37cd-4fd7-bcc4-830fa4e0848f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.310876 Apr 30 13:19:38.649036 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 450/887] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:38 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:39.666176 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:39.667202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:39.676036 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.676493 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:39.677535 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.677980 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.047101 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.064989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f3166712-f24e-4d77-bbe0-0627d916e092 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.395476 Apr 30 13:19:40.064989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 438/888] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:39 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:40.591153 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-3d6c4823-f99a-46ea-b0f5-4d195c56ade7 req-24b105df-308c-4e40-a742-d643150348f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1f86b9-d5f9-4c52-bdf6-be893bb1643c", "name": "network-vif-plugged", "status": "completed", "tag": "57af5644-3314-452d-aaab-c8e4f96b1121"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:40.592921 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:40.592921 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:19:40.602673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-3d6c4823-f99a-46ea-b0f5-4d195c56ade7 req-24b105df-308c-4e40-a742-d643150348f0 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:40.603649 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-3d6c4823-f99a-46ea-b0f5-4d195c56ade7 req-24b105df-308c-4e40-a742-d643150348f0 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.630320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-3d6c4823-f99a-46ea-b0f5-4d195c56ade7 req-24b105df-308c-4e40-a742-d643150348f0 service nova] Creating event network-vif-plugged:57af5644-3314-452d-aaab-c8e4f96b1121 for instance ee1f86b9-d5f9-4c52-bdf6-be893bb1643c on hv-cinder-78445 Apr 30 13:19:40.635833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-3d6c4823-f99a-46ea-b0f5-4d195c56ade7 req-24b105df-308c-4e40-a742-d643150348f0 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Apr 30 13:19:40.636761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 451/889] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:41.080280 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:41.081590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:41.096991 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.097907 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.099351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.100418 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.356619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:41.366862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52e236db-f1d9-463f-9695-74dee7937d5b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1318 microversion: 2.1 time: 0.294072 Apr 30 13:19:41.367866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 439/890] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:41 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:42.388869 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:42.390232 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:42.405263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.406210 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.407891 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.408553 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.722839 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:42.731951 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-214fe626-508b-42f8-a645-1de4a929db93 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1508 microversion: 2.1 time: 0.350646 Apr 30 13:19:42.732532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 452/891] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:42 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:42.749857 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ce5b41-5737-4ac0-a84c-26e731acf057"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:42.751577 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:42.759804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.760453 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.761251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.761786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.973527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Invalid volume: volume f4ce5b41-5737-4ac0-a84c-26e731acf057 is already attached to instances: ccecde33-e41a-46fc-9ee1-f0834326656f Apr 30 13:19:42.974276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 400 to user: Invalid volume: volume f4ce5b41-5737-4ac0-a84c-26e731acf057 is already attached to instances: ccecde33-e41a-46fc-9ee1-f0834326656f {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:42.975193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5765da00-1905-4784-982b-b4e028345cbb tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.230083 Apr 30 13:19:42.975988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 440/892] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:42 2021] POST /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c/os-volume_attachments => generated 174 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 13:19:43.091873 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:43.092373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:43.100859 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.101589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.102620 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.103183 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.275278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lazy-loading 'services' on Instance uuid ccecde33-e41a-46fc-9ee1-f0834326656f {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:43.457101 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1361f41f-99a3-444c-8781-cc9ace7b615e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f/os-volume_attachments/f4ce5b41-5737-4ac0-a84c-26e731acf057" status: 202 len: 0 microversion: 2.1 time: 0.368050 Apr 30 13:19:43.460259 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 453/893] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:19:43 2021] DELETE /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f/os-volume_attachments/f4ce5b41-5737-4ac0-a84c-26e731acf057 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:19:44.851959 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-894084338", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "80f53de5-5259-4652-858e-b5c33566feb0"}]}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:44.919771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] validate_networks() for [('80f53de5-5259-4652-858e-b5c33566feb0', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:19:45.593584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:19:45.593999 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:19:45.594466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:19:45.594998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:19:45.595409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:19:45.604675 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.605131 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.605968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.606404 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.626742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:19:45.631054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for user 7c2b47c937514fe881a9512043d199e9 and project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:19:45.642989 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:19:45.645483 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:19:45.699822 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-fd715570-5bad-4fd5-aefe-2df622b32b9b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851068 Apr 30 13:19:45.700391 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 441/894] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:19:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:19:45.712452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-27e92637-b6eb-45d7-a01a-a6aefae79b0e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:45.713193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-27e92637-b6eb-45d7-a01a-a6aefae79b0e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:45.808916 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-27e92637-b6eb-45d7-a01a-a6aefae79b0e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:45.817979 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-27e92637-b6eb-45d7-a01a-a6aefae79b0e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1217 microversion: 2.1 time: 0.110236 Apr 30 13:19:45.819222 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 454/895] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:45 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:46.837589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:46.838956 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:46.846794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.847260 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.848054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.848492 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.992374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:47.001694 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-df1670c8-c371-4673-968a-1514e8225b38 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1277 microversion: 2.1 time: 0.167919 Apr 30 13:19:47.002928 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 442/896] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:46 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:48.022906 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:48.023558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:48.032046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:48.032774 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:48.034577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:48.035303 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:48.633156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:48.642710 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9e1c4ef9-14b6-4d9b-a9d2-988be955e78a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.623292 Apr 30 13:19:48.653520 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 455/897] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:48 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:49.431778 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-3c2b0dab-8c1b-4c33-99f2-eb29104d9101 req-9891a3e3-e3e7-4292-aba7-fbd1a7f82179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22e5429b-f624-42d7-b78d-9b5acaad06db", "tag": "0d8e07c1-e16e-43ce-9cc2-913f73d9bd08"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:49.434218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:49.434218 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:19:49.453205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3c2b0dab-8c1b-4c33-99f2-eb29104d9101 req-9891a3e3-e3e7-4292-aba7-fbd1a7f82179 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.454080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-3c2b0dab-8c1b-4c33-99f2-eb29104d9101 req-9891a3e3-e3e7-4292-aba7-fbd1a7f82179 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.472422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-3c2b0dab-8c1b-4c33-99f2-eb29104d9101 req-9891a3e3-e3e7-4292-aba7-fbd1a7f82179 service nova] Creating event network-changed:0d8e07c1-e16e-43ce-9cc2-913f73d9bd08 for instance 22e5429b-f624-42d7-b78d-9b5acaad06db on hv-cinder-78445 Apr 30 13:19:49.478136 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-3c2b0dab-8c1b-4c33-99f2-eb29104d9101 req-9891a3e3-e3e7-4292-aba7-fbd1a7f82179 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050102 Apr 30 13:19:49.479324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 443/898] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:49.664243 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:49.665524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:49.676294 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.676753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.677598 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.678046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.206045 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:50.220549 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9bd6c370-ef52-430a-b7d0-810094a19952 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.563334 Apr 30 13:19:50.221399 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 456/899] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:49 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:51.238432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:51.239135 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:51.247191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.247644 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.248435 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.248862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.453461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.462307 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6b3b2089-6ec1-4d92-8947-8d761a5a85de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.228052 Apr 30 13:19:51.462920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 444/900] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:51 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:52.483665 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:52.486315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:52.499479 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.500280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.501925 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.502712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.727495 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.737440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-2eea6082-faf9-48ac-9e73-3d6a44e13b11 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.260571 Apr 30 13:19:52.738284 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 457/901] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:52 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:53.756386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:53.757712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:53.767884 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.768468 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.769465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.770161 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.026308 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:54.035670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5b5bb4fa-dddb-4bef-980b-2261e036c35d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.284537 Apr 30 13:19:54.036294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 445/902] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:53 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:55.055571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:55.056608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:55.065191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.065756 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.066558 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.067002 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.318212 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.330380 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-36fcef60-c894-403d-9f45-1f40f5ecad7a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.279605 Apr 30 13:19:55.331110 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 458/903] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:55 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:56.354005 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:56.354777 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:56.363243 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.363683 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.364484 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.365010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.628016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:56.648412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-89238e33-844b-4ba1-bfbf-b49221ba116a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.297708 Apr 30 13:19:56.649720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 446/904] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:56 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:56.735980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-8951d4b1-66d7-46ea-90ab-dabf2b6728d0 req-ffdd6ec6-bcfe-46cb-ad2f-84610abef4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e5429b-f624-42d7-b78d-9b5acaad06db", "name": "network-vif-plugged", "status": "completed", "tag": "0d8e07c1-e16e-43ce-9cc2-913f73d9bd08"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:56.737847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:56.737847 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:19:56.749626 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8951d4b1-66d7-46ea-90ab-dabf2b6728d0 req-ffdd6ec6-bcfe-46cb-ad2f-84610abef4a2 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.750463 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8951d4b1-66d7-46ea-90ab-dabf2b6728d0 req-ffdd6ec6-bcfe-46cb-ad2f-84610abef4a2 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.770015 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-8951d4b1-66d7-46ea-90ab-dabf2b6728d0 req-ffdd6ec6-bcfe-46cb-ad2f-84610abef4a2 service nova] Creating event network-vif-plugged:0d8e07c1-e16e-43ce-9cc2-913f73d9bd08 for instance 22e5429b-f624-42d7-b78d-9b5acaad06db on hv-cinder-78445 Apr 30 13:19:56.776000 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-8951d4b1-66d7-46ea-90ab-dabf2b6728d0 req-ffdd6ec6-bcfe-46cb-ad2f-84610abef4a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043919 Apr 30 13:19:56.776781 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 459/905] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:57.671425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:57.672377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:57.680646 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:57.681083 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:57.681922 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:57.682374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:57.928972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:57.944381 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d584039e-38b5-468f-bb16-ab4370ab8bce tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1317 microversion: 2.1 time: 0.276861 Apr 30 13:19:57.945202 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 447/906] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:57 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:58.964529 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:58.965508 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:58.975468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.976268 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.977841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.978515 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.261527 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:59.275656 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-647c585d-5972-453f-b6ee-b8f3d5c2a649 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1506 microversion: 2.1 time: 0.315034 Apr 30 13:19:59.276747 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 460/907] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:58 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:01.114807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e0363f-ed64-455d-bf67-7c4cecd9adb8"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:01.116480 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:01.128690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.129351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.130581 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.131226 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.734707 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-e96a4530-1125-4f6d-8f3f-2bac72045d49 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.625999 Apr 30 13:20:01.735918 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 448/908] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:20:01 2021] POST /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:09.882501 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e0363f-ed64-455d-bf67-7c4cecd9adb8"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:09.884227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:09.898177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:09.898975 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:09.900577 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:09.901287 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:10.146269 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Invalid volume: volume e9e0363f-ed64-455d-bf67-7c4cecd9adb8 is already attached to instances: 22e5429b-f624-42d7-b78d-9b5acaad06db Apr 30 13:20:10.147302 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 400 to user: Invalid volume: volume e9e0363f-ed64-455d-bf67-7c4cecd9adb8 is already attached to instances: 22e5429b-f624-42d7-b78d-9b5acaad06db {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:10.149162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-3cc8e47d-5df9-4a2d-91a3-d4ffc8721799 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.272605 Apr 30 13:20:10.149960 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 461/909] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:20:09 2021] POST /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:20:10.280929 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:10.281755 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:10.291786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:10.292402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:10.293532 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:10.294065 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:10.581972 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lazy-loading 'services' on Instance uuid 22e5429b-f624-42d7-b78d-9b5acaad06db {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:10.761356 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0dfc002d-c570-4f73-b85a-e795b3bd799e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments/e9e0363f-ed64-455d-bf67-7c4cecd9adb8" status: 202 len: 0 microversion: 2.1 time: 0.485658 Apr 30 13:20:10.762012 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 449/910] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:10 2021] DELETE /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db/os-volume_attachments/e9e0363f-ed64-455d-bf67-7c4cecd9adb8 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:20:12.181075 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-290196179", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452", "networks": [{"uuid": "80f53de5-5259-4652-858e-b5c33566feb0"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:12.281093 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] validate_networks() for [('80f53de5-5259-4652-858e-b5c33566feb0', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:20:13.155427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:20:13.156865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:20:13.157497 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:20:13.158028 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:20:13.158567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:20:13.170570 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:13.171172 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:13.172684 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:13.173244 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:13.197581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:13.208488 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Getting quotas for user 7c2b47c937514fe881a9512043d199e9 and project ea398af75bc44966965248e1ea7440c4. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:13.226108 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:20:13.229749 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:20:13.290772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-631b7227-e4f2-407d-9496-a3b77cdd7610 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.113859 Apr 30 13:20:13.295281 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 462/911] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:20:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:20:13.307690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2c006d5e-cb58-49ed-89ad-6ad3f4616bf1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:13.308521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2c006d5e-cb58-49ed-89ad-6ad3f4616bf1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:13.464377 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2c006d5e-cb58-49ed-89ad-6ad3f4616bf1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:13.475608 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2c006d5e-cb58-49ed-89ad-6ad3f4616bf1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1217 microversion: 2.1 time: 0.173459 Apr 30 13:20:13.476832 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 450/912] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:13 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:14.510683 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:14.514697 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:14.559056 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.560367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.562281 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.563213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.773980 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:14.794112 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f3e45dfc-84a4-4c25-925e-e61b353dd830 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1269 microversion: 2.1 time: 0.296384 Apr 30 13:20:14.795133 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 463/913] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:14 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:15.827407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:15.831322 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:15.852730 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:15.853967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:15.856177 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:15.857276 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:16.252413 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:16.266817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b83c0c0d-02e5-4dc8-a628-437f37a92fe8 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1287 microversion: 2.1 time: 0.449406 Apr 30 13:20:16.282771 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 451/914] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:15 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1287 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:17.295455 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:17.296178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:17.305256 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:17.306182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:17.307168 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:17.307797 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:17.725472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:17.739433 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ab04e956-78f0-4c2c-826f-74209e44e628 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.447622 Apr 30 13:20:17.740381 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 464/915] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:17 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:18.761924 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:18.763573 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:18.785211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.786602 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:18.788818 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.789556 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:19.386847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:19.410324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-46906772-7aa4-43c1-a518-2f737d1ad068 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.654165 Apr 30 13:20:19.412444 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 452/916] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:18 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:19.527496 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-e5365c58-13e1-4e6a-90c8-945848203255 req-559974a8-5678-491e-a226-75616bc42683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c2fa302-f0b9-426b-b004-e9edca678f94", "tag": "8129ddd6-d7bc-4523-886b-949686faad64"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:19.529702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:19.529702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:20:19.542017 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e5365c58-13e1-4e6a-90c8-945848203255 req-559974a8-5678-491e-a226-75616bc42683 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:19.542483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-e5365c58-13e1-4e6a-90c8-945848203255 req-559974a8-5678-491e-a226-75616bc42683 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:19.587187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-e5365c58-13e1-4e6a-90c8-945848203255 req-559974a8-5678-491e-a226-75616bc42683 service nova] Creating event network-changed:8129ddd6-d7bc-4523-886b-949686faad64 for instance 5c2fa302-f0b9-426b-b004-e9edca678f94 on hv-cinder-78445 Apr 30 13:20:19.616739 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-e5365c58-13e1-4e6a-90c8-945848203255 req-559974a8-5678-491e-a226-75616bc42683 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093343 Apr 30 13:20:19.620187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 465/917] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:20:20.435139 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:20.437004 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:20.446742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:20.448262 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:20.449490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:20.450103 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:20.854648 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:20.870709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3e0af17b-776e-4d5c-a5ca-583bc6685ab0 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.439250 Apr 30 13:20:20.872278 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 453/918] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:20 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:21.902978 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:21.905667 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:21.940091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.940791 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:21.941816 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.942410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:22.304888 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:22.319171 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ff9e80ad-3ba8-41ee-ac3c-6feba484c5ac tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.427011 Apr 30 13:20:22.320272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 466/919] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:21 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:23.342237 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:23.344271 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:23.359479 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:23.360961 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:23.363200 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:23.364239 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:23.938747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:23.961550 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-12a944c7-fc1c-4337-be4f-54210dff7338 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.626396 Apr 30 13:20:23.963066 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 454/920] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:23 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:24.988646 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:24.989277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:25.008606 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:25.009511 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:25.010708 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:25.014103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:26.051733 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:26.088052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-33b044ca-04d0-44d0-a68e-8d14ca7987c2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 1.103289 Apr 30 13:20:26.101781 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 467/921] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:24 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:27.132241 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:27.134858 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:27.184099 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:27.185751 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:27.187232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:27.189359 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:28.024591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:28.043600 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8af7f429-bd01-49d9-a1db-290f82d6e6de tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.927234 Apr 30 13:20:28.049128 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 455/922] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:27 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:28.432522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:28.437026 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:28.457054 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-eda56a62-dd94-456b-8fec-f9b834de00fc req-05ec8fac-bbed-4dc5-8a63-26caadd9ec9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:28.467746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:28.467746 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:20:28.489424 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:28.490247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:28.498818 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:28.501630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:28.531928 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-eda56a62-dd94-456b-8fec-f9b834de00fc req-05ec8fac-bbed-4dc5-8a63-26caadd9ec9d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:28.533341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-eda56a62-dd94-456b-8fec-f9b834de00fc req-05ec8fac-bbed-4dc5-8a63-26caadd9ec9d service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:28.641182 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-eda56a62-dd94-456b-8fec-f9b834de00fc req-05ec8fac-bbed-4dc5-8a63-26caadd9ec9d service nova] Creating event network-changed:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:20:28.657429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-eda56a62-dd94-456b-8fec-f9b834de00fc req-05ec8fac-bbed-4dc5-8a63-26caadd9ec9d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207246 Apr 30 13:20:28.661457 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 456/923] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:28.766905 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:29.080534 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:29.082651 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:29.130786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.132959 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.140327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.141563 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.151172 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-94eee880-dd4d-4ea5-b333-40383bfd81ba tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "DELETE /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 204 len: 0 microversion: 2.1 time: 0.724626 Apr 30 13:20:29.152736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 468/924] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:28 2021] DELETE /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:20:29.181114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:29.182834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:29.216151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.222111 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.226850 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.228063 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.990341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:30.006978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3117f579-ac3d-4431-a786-11b49b356958 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.936631 Apr 30 13:20:30.008041 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 457/925] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:29 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:30.147003 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:30.160593 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6edd3ad7-7e16-4ac9-a45e-79fdf94894b3 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1568 microversion: 2.1 time: 1.000092 Apr 30 13:20:30.164245 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 469/926] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:29 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1568 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:31.033638 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:31.034511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:31.053268 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.053765 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.054579 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.055016 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.195732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:31.196533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:31.227506 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.228260 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.229364 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.230006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:32.274092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:32.285450 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-df31228a-c073-4daa-9da8-3a1381359d54 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 1.255919 Apr 30 13:20:32.295031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 458/927] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:31 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:32.300893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-7fff66f2-3b8e-469d-b2cd-507d09ea8c40 req-921d53f0-3cc0-4f56-ae08-503b8ae87521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2fa302-f0b9-426b-b004-e9edca678f94", "name": "network-vif-plugged", "status": "completed", "tag": "8129ddd6-d7bc-4523-886b-949686faad64"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:32.307235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:32.307235 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:20:32.329149 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7fff66f2-3b8e-469d-b2cd-507d09ea8c40 req-921d53f0-3cc0-4f56-ae08-503b8ae87521 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:32.329804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7fff66f2-3b8e-469d-b2cd-507d09ea8c40 req-921d53f0-3cc0-4f56-ae08-503b8ae87521 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:32.365076 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-7fff66f2-3b8e-469d-b2cd-507d09ea8c40 req-921d53f0-3cc0-4f56-ae08-503b8ae87521 service nova] Creating event network-vif-plugged:8129ddd6-d7bc-4523-886b-949686faad64 for instance 5c2fa302-f0b9-426b-b004-e9edca678f94 on hv-cinder-78445 Apr 30 13:20:32.376196 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-7fff66f2-3b8e-469d-b2cd-507d09ea8c40 req-921d53f0-3cc0-4f56-ae08-503b8ae87521 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079077 Apr 30 13:20:32.379619 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 459/928] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:32.511429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:32.524801 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7554a28a-6366-447f-9469-d9c7fd68713a tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1450 microversion: 2.1 time: 1.332942 Apr 30 13:20:32.528903 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 470/929] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:31 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1450 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:33.074990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-6cb4f44d-de5b-4270-84b9-617c7ffeb5e9 req-125913b8-4d3d-4b61-8c42-472d0334b451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99cbde8a-c152-4038-a60b-9efd8cd55037", "name": "network-vif-deleted", "tag": "5a4062f2-4fa0-496f-b854-05006c824a01"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:33.085133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:33.085133 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:20:33.141814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6cb4f44d-de5b-4270-84b9-617c7ffeb5e9 req-125913b8-4d3d-4b61-8c42-472d0334b451 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.146064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-6cb4f44d-de5b-4270-84b9-617c7ffeb5e9 req-125913b8-4d3d-4b61-8c42-472d0334b451 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.190265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-6cb4f44d-de5b-4270-84b9-617c7ffeb5e9 req-125913b8-4d3d-4b61-8c42-472d0334b451 service nova] Creating event network-vif-deleted:5a4062f2-4fa0-496f-b854-05006c824a01 for instance 99cbde8a-c152-4038-a60b-9efd8cd55037 on hv-cinder-78445 Apr 30 13:20:33.218896 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-6cb4f44d-de5b-4270-84b9-617c7ffeb5e9 req-125913b8-4d3d-4b61-8c42-472d0334b451 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165973 Apr 30 13:20:33.225019 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 460/930] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:33.322569 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:33.323681 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:33.359800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.360829 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.362472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.363401 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.563691 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:33.590515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:33.634584 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.635629 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.640035 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.642446 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:34.149863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:34.186826 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b0b819af-2336-4f52-89dd-87f28b526adf tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.868775 Apr 30 13:20:34.189611 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 471/931] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:33 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:34.236324 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c88c75fe03843c9ad120269832bc227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e010a31d7104f119fb0a3ab9fe7e8bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:34.251199 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-52463791-f3b5-4c0f-a3d5-a17670b1ac44 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 200 len: 1220 microversion: 2.1 time: 0.706828 Apr 30 13:20:34.252474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 461/932] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:33 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 1220 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:35.221031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:35.222845 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:35.253471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.259422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.263034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.266740 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.341584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Action: 'create', calling method: .version_select at 0x7fe2fae0d820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-631961270"}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:35.372938 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:35.381574 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for user 567cada28b6a4c2698bcf34bf61d427f and project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:35.791211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:35.810387 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5f55bee1-d339-47a0-b809-5c79d571df08 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1317 microversion: 2.1 time: 0.597693 Apr 30 13:20:35.812679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 462/933] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:35 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:35.825253 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:35.830877 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] [instance: 99cbde8a-c152-4038-a60b-9efd8cd55037] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:35.846074 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.847407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.848810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.849835 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.968195 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] HTTP exception thrown: Instance 99cbde8a-c152-4038-a60b-9efd8cd55037 could not be found. Apr 30 13:20:35.969576 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Returning 404 to user: Instance 99cbde8a-c152-4038-a60b-9efd8cd55037 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:35.971165 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c97d458d-bbf1-42d9-86a6-762c0e6b35ab tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037" status: 404 len: 111 microversion: 2.1 time: 0.156244 Apr 30 13:20:35.972429 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 463/934] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:35 2021] GET /compute/v2.1/servers/99cbde8a-c152-4038-a60b-9efd8cd55037 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:20:36.050061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:36.059059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for user 567cada28b6a4c2698bcf34bf61d427f and project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'key_pairs'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:36.085707 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a1375a66-3d6d-45ca-91c9-40dc572e4921 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.153123 Apr 30 13:20:36.087800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 472/935] 10.222.0.69 () {60 vars in 1158 bytes} [Fri Apr 30 13:20:34 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:36.415338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-888a3356-6b62-46b8-9c4e-88036a02f959 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] Calling method '.version_select at 0x7fe2fb4c33a0>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:36.470472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-888a3356-6b62-46b8-9c4e-88036a02f959 tempest-TestShelveInstance-2068471867 tempest-TestShelveInstance-2068471867-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1313915457" status: 202 len: 0 microversion: 2.1 time: 0.072160 Apr 30 13:20:36.481181 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 464/936] 10.222.0.69 () {58 vars in 1254 bytes} [Fri Apr 30 13:20:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1313915457 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:20:36.836228 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:36.838557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:36.874750 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.877431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:36.881005 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.882689 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:37.446173 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:37.491602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9de70471-7beb-4ccb-b910-fa45b309efa1 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1506 microversion: 2.1 time: 0.663327 Apr 30 13:20:37.510576 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 473/937] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:36 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1506 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:39.805717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "026760d8-d9f9-430d-9c77-d468fabafe20"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:39.809152 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:39.826814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.828031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.831298 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.832499 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:40.823754 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7d536b22-9e52-4b52-a474-d6296052072b tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "POST /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025223 Apr 30 13:20:40.829069 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 465/938] 10.222.0.69 () {60 vars in 1323 bytes} [Fri Apr 30 13:20:39 2021] POST /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94/os-volume_attachments => generated 194 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:48.560193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:48.561024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:48.564794 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:20:48.571279 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.571736 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.572548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.573013 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.761875 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lazy-loading 'services' on Instance uuid 5c2fa302-f0b9-426b-b004-e9edca678f94 {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:48.927722 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-eea6b46d-55ad-4237-b8f8-523bf60f8208 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94/os-volume_attachments/026760d8-d9f9-430d-9c77-d468fabafe20" status: 202 len: 0 microversion: 2.1 time: 0.371665 Apr 30 13:20:48.928812 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 474/939] 10.222.0.69 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:48 2021] DELETE /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94/os-volume_attachments/026760d8-d9f9-430d-9c77-d468fabafe20 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:20:51.712747 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:51.713613 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:51.724527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.725264 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.726665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.727400 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.829184 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:52.022237 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2e089313-5ee7-4d04-9613-f2c3682c3406 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 204 len: 0 microversion: 2.1 time: 0.313360 Apr 30 13:20:52.022855 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 466/940] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:51 2021] DELETE /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:20:52.048732 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:52.049928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:52.069863 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.070532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.072257 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.072947 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.140996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 55640. Apr 30 13:20:52.461638 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:52.485700 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7d07f992-a521-464b-90cf-eaa2df174755 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1512 microversion: 2.1 time: 0.454844 Apr 30 13:20:52.486680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 475/941] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:52 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:53.523973 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:53.525658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:53.534990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:53.535443 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:53.536269 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:53.536720 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:53.992329 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:54.001772 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b4c14007-653b-483d-8828-61db45eadb5f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1512 microversion: 2.1 time: 0.486678 Apr 30 13:20:54.002486 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 467/942] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:53 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1512 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:55.032987 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:55.034340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:55.049031 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.050199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.051485 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.052144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.291708 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-2802c04a-7600-4530-98d9-564188cb4946 req-7e21d3a4-7486-4b17-add9-f98304afd7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c2fa302-f0b9-426b-b004-e9edca678f94", "name": "network-vif-deleted", "tag": "8129ddd6-d7bc-4523-886b-949686faad64"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:55.295615 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:55.295615 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:20:55.318784 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2802c04a-7600-4530-98d9-564188cb4946 req-7e21d3a4-7486-4b17-add9-f98304afd7bd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.320026 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2802c04a-7600-4530-98d9-564188cb4946 req-7e21d3a4-7486-4b17-add9-f98304afd7bd service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.358785 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-2802c04a-7600-4530-98d9-564188cb4946 req-7e21d3a4-7486-4b17-add9-f98304afd7bd service nova] Creating event network-vif-deleted:8129ddd6-d7bc-4523-886b-949686faad64 for instance 5c2fa302-f0b9-426b-b004-e9edca678f94 on hv-cinder-78445 Apr 30 13:20:55.366225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-2802c04a-7600-4530-98d9-564188cb4946 req-7e21d3a4-7486-4b17-add9-f98304afd7bd service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082609 Apr 30 13:20:55.367887 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.371287 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 468/943] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:55.384913 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ee106e68-e854-471a-86f8-b8aa600bddaa tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 200 len: 1470 microversion: 2.1 time: 0.360327 Apr 30 13:20:55.386405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 476/944] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:55 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:56.416512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:56.418019 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 5c2fa302-f0b9-426b-b004-e9edca678f94] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:56.433244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.434243 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.435842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.436723 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.514355 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Instance 5c2fa302-f0b9-426b-b004-e9edca678f94 could not be found. Apr 30 13:20:56.514990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 404 to user: Instance 5c2fa302-f0b9-426b-b004-e9edca678f94 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:56.516029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-10341198-bc8a-4435-b3b1-7652caa72d06 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94" status: 404 len: 111 microversion: 2.1 time: 0.108225 Apr 30 13:20:56.516654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 469/945] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:56 2021] GET /compute/v2.1/servers/5c2fa302-f0b9-426b-b004-e9edca678f94 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:20:57.415114 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-380849742", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631961270", "security_groups": [{"name": "tempest-secgroup-smoke-1987593170"}], "block_device_mapping_v2": [{"uuid": "ee06f04b-485b-43c7-9b1c-b0bf84ea2604", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b163249-98b0-4843-a8e2-23079bfd6bc7"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:57.617755 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] validate_networks() for [('2b163249-98b0-4843-a8e2-23079bfd6bc7', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:20:57.914857 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:57.915722 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:57.925956 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.926411 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.927225 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.927690 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.001140 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:58.151206 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d0c1a876-cd6f-44a9-9401-a3e349949e5d tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 204 len: 0 microversion: 2.1 time: 0.240165 Apr 30 13:20:58.152456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 470/946] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:57 2021] DELETE /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:20:58.165430 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:58.166112 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:58.175255 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.175806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.176686 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.177166 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.618344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:58.623693 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:20:58.624513 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:20:58.625399 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:20:58.626083 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:20:58.626629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:20:58.631340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-29beb50e-763e-4756-b3a1-f7ee49ec9be3 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1512 microversion: 2.1 time: 0.473103 Apr 30 13:20:58.631947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 471/947] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:58 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:58.637695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.638332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.639368 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.639919 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.660098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:58.666763 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for user 567cada28b6a4c2698bcf34bf61d427f and project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:58.793213 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:20:58.795576 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee06f04b-485b-43c7-9b1c-b0bf84ea2604',volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:20:59.030012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6aad78a8-d1c4-4fa5-bd77-c94c9890b40d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.618600 Apr 30 13:20:59.031162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 477/948] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:20:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:20:59.043151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-047a4cde-d3a4-4f29-b5d6-08ec73b22a60 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:59.044570 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-047a4cde-d3a4-4f29-b5d6-08ec73b22a60 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:59.122351 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-047a4cde-d3a4-4f29-b5d6-08ec73b22a60 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:59.131490 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-047a4cde-d3a4-4f29-b5d6-08ec73b22a60 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1093 microversion: 2.1 time: 0.092876 Apr 30 13:20:59.132291 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 472/949] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:59 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:59.650259 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:59.651285 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:59.661016 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.661505 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.662315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.662761 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.956059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:59.968961 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8bdb560f-fe9e-4e6c-9da2-2f57654edc3f tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1512 microversion: 2.1 time: 0.323317 Apr 30 13:20:59.969650 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 478/950] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:59 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:00.155879 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:00.157061 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:00.172716 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.173481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.175224 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.175758 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.366302 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:00.377017 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ed75e857-ec30-4a62-bda8-11c435e5380a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1191 microversion: 2.1 time: 0.227978 Apr 30 13:21:00.392661 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 473/951] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:00 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:00.981059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-1f9ddb00-12b3-4aa1-ac93-9cec78f64582 req-3c4c2900-1b3e-4691-8156-f2cfe69fee84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22e5429b-f624-42d7-b78d-9b5acaad06db", "name": "network-vif-deleted", "tag": "0d8e07c1-e16e-43ce-9cc2-913f73d9bd08"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:00.983267 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:00.983267 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:21:00.996512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-1f9ddb00-12b3-4aa1-ac93-9cec78f64582 req-3c4c2900-1b3e-4691-8156-f2cfe69fee84 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.997365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-1f9ddb00-12b3-4aa1-ac93-9cec78f64582 req-3c4c2900-1b3e-4691-8156-f2cfe69fee84 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.018678 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:01.023060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:01.030191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-1f9ddb00-12b3-4aa1-ac93-9cec78f64582 req-3c4c2900-1b3e-4691-8156-f2cfe69fee84 service nova] Creating event network-vif-deleted:0d8e07c1-e16e-43ce-9cc2-913f73d9bd08 for instance 22e5429b-f624-42d7-b78d-9b5acaad06db on hv-cinder-78445 Apr 30 13:21:01.044903 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.047527 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.048180 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-1f9ddb00-12b3-4aa1-ac93-9cec78f64582 req-3c4c2900-1b3e-4691-8156-f2cfe69fee84 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070541 Apr 30 13:21:01.049305 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 479/952] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:01.050533 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.051541 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.234285 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:01.242868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-aa6fa58f-b959-494b-baae-7251e9abb102 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 200 len: 1302 microversion: 2.1 time: 0.247303 Apr 30 13:21:01.243470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 474/953] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:00 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 1302 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:01.403698 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:01.404902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:01.416487 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.417262 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.418373 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.419121 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.625823 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:01.641741 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-add1e57d-1238-44d9-a10c-e5c0bb86037f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1209 microversion: 2.1 time: 0.242091 Apr 30 13:21:01.642403 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 480/954] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:01 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1209 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:02.264596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.266019 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: 22e5429b-f624-42d7-b78d-9b5acaad06db] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.279941 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.280743 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.282229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.283031 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.381565 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Instance 22e5429b-f624-42d7-b78d-9b5acaad06db could not be found. Apr 30 13:21:02.382881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 404 to user: Instance 22e5429b-f624-42d7-b78d-9b5acaad06db could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:02.383091 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0517ff15-ca10-468a-a025-860a79c0ee3a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db" status: 404 len: 111 microversion: 2.1 time: 0.125701 Apr 30 13:21:02.383677 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 475/955] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:02 2021] GET /compute/v2.1/servers/22e5429b-f624-42d7-b78d-9b5acaad06db => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:21:02.397362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.398661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.413274 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.414288 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.415629 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.416543 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.551578 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Going to try to terminate instance {{(pid=87984) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:21:02.660654 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.661209 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.669201 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.669956 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.671082 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.671836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.714557 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e90d45e6-39b1-467a-9574-0b7b9104f568 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 204 len: 0 microversion: 2.1 time: 0.324625 Apr 30 13:21:02.715575 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 481/956] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:21:02 2021] DELETE /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:21:02.727100 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.728024 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.737842 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.739047 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.740632 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.741113 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.311601 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:03.321242 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ed7d49dc-8399-42b7-9bf3-4845df3ecd5a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1514 microversion: 2.1 time: 0.599039 Apr 30 13:21:03.321999 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 482/957] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:02 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1514 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:03.340275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:03.349802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-24a99e76-4e4a-4087-8cfd-327558cb4e1c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.693473 Apr 30 13:21:03.350399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 476/958] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:02 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:03.618340 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-2efc76c6-7b9e-4789-8799-3614671c2cb4 req-3b9cf16d-3732-4fbf-808f-6edb63b9cc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86053f5e-dd6e-4517-ad56-198ac12b3ab1", "tag": "c4bbd718-6742-46d3-8446-2788220e82f8"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:03.624393 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:03.624393 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:21:03.634949 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-2efc76c6-7b9e-4789-8799-3614671c2cb4 req-3b9cf16d-3732-4fbf-808f-6edb63b9cc27 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.635414 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-2efc76c6-7b9e-4789-8799-3614671c2cb4 req-3b9cf16d-3732-4fbf-808f-6edb63b9cc27 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.657989 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-2efc76c6-7b9e-4789-8799-3614671c2cb4 req-3b9cf16d-3732-4fbf-808f-6edb63b9cc27 service nova] Creating event network-changed:c4bbd718-6742-46d3-8446-2788220e82f8 for instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 on hv-cinder-78445 Apr 30 13:21:03.663512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-2efc76c6-7b9e-4789-8799-3614671c2cb4 req-3b9cf16d-3732-4fbf-808f-6edb63b9cc27 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054511 Apr 30 13:21:03.664392 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 483/959] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:04.343544 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:04.345316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:04.354624 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.355116 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.355967 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.356425 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.376170 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:04.378011 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:04.397832 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.399022 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.401271 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.403309 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.045751 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:05.054297 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:05.062924 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-fde779b0-325b-4d37-bcb8-283303b29c93 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.693485 Apr 30 13:21:05.064494 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 484/960] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:04 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:05.075902 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-644961ee-4a85-492f-b4f5-499cecb737ed tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1514 microversion: 2.1 time: 0.735631 Apr 30 13:21:05.077481 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 477/961] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:04 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1514 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:05.479749 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-edf85fca-105a-4396-80cc-e129d24e4d10 req-c6c30f20-0cd8-435a-89c0-09340b87b2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1f86b9-d5f9-4c52-bdf6-be893bb1643c", "name": "network-vif-deleted", "tag": "57af5644-3314-452d-aaab-c8e4f96b1121"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:05.483220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:05.483220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:21:05.505694 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-edf85fca-105a-4396-80cc-e129d24e4d10 req-c6c30f20-0cd8-435a-89c0-09340b87b2b7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.506143 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-edf85fca-105a-4396-80cc-e129d24e4d10 req-c6c30f20-0cd8-435a-89c0-09340b87b2b7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.525982 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-edf85fca-105a-4396-80cc-e129d24e4d10 req-c6c30f20-0cd8-435a-89c0-09340b87b2b7 service nova] Creating event network-vif-deleted:57af5644-3314-452d-aaab-c8e4f96b1121 for instance ee1f86b9-d5f9-4c52-bdf6-be893bb1643c on hv-cinder-78445 Apr 30 13:21:05.531958 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-edf85fca-105a-4396-80cc-e129d24e4d10 req-c6c30f20-0cd8-435a-89c0-09340b87b2b7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060179 Apr 30 13:21:05.535452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 485/962] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:06.102811 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:06.103893 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:06.109655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:06.111046 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:06.116270 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.117221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.118791 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.119657 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.130843 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.131754 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.134236 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.135191 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.240009 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.241873 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.242712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lazy-loading 'fault' on Instance uuid ee1f86b9-d5f9-4c52-bdf6-be893bb1643c {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:21:06.359807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:06.377244 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-1d4eee7f-7ccb-4b9f-bac6-cd085158080a tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 200 len: 1308 microversion: 2.1 time: 0.282682 Apr 30 13:21:06.378466 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 478/963] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:06 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:06.520854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:06.539356 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-baa7e3c5-32de-4b31-9825-6fb1b62901b7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.439396 Apr 30 13:21:06.540687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 486/964] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:06 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:07.406358 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:07.407438 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ee1f86b9-d5f9-4c52-bdf6-be893bb1643c] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:07.422650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.423472 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.424957 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.425844 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.512562 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Instance ee1f86b9-d5f9-4c52-bdf6-be893bb1643c could not be found. Apr 30 13:21:07.513294 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 404 to user: Instance ee1f86b9-d5f9-4c52-bdf6-be893bb1643c could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:07.514221 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-8b34d7af-0fce-4506-83e2-eaf4ec5d9f02 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c" status: 404 len: 111 microversion: 2.1 time: 0.115133 Apr 30 13:21:07.514976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 479/965] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:07 2021] GET /compute/v2.1/servers/ee1f86b9-d5f9-4c52-bdf6-be893bb1643c => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:21:07.564861 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:07.565828 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:07.574105 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.574562 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.575349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.575772 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.895803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:07.907032 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-115c2c93-ae32-494c-baf9-aed8d62006a0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.346171 Apr 30 13:21:07.907928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 487/966] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:07 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:08.845914 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:08.846626 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:08.854735 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.855185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.855990 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.856414 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.930538 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:08.931232 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:21:08.931675 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:08.944844 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.945836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.947235 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.948057 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.074829 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-21fe8825-867d-4b3f-bc1f-03378d52f426 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "DELETE /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 204 len: 0 microversion: 2.1 time: 0.232660 Apr 30 13:21:09.075694 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 480/967] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:21:08 2021] DELETE /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:21:09.087556 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:09.088543 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:09.098487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.099014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.099970 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.100447 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.267941 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:09.277111 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-e326414b-b0a9-44e7-8e4a-a8dad6d56794 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.351924 Apr 30 13:21:09.277738 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 488/968] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:08 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:09.361757 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:09.372032 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-ff43c958-621b-4ada-aba6-a04f4d581bae tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1513 microversion: 2.1 time: 0.291441 Apr 30 13:21:09.372662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 481/969] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:09 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:10.295002 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:10.295702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:10.304857 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:10.305308 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:10.306125 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:10.306587 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:10.396767 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:10.398033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:10.411994 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:10.412798 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:10.414245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:10.415078 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:10.639377 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:10.649651 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b904def6-73a4-452e-ae9a-1ae65a4cafb8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.358625 Apr 30 13:21:10.650469 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 489/970] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:10 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:10.901670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:10.912141 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2a53c51b-060b-4023-80c5-d555418f19e2 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1513 microversion: 2.1 time: 0.522664 Apr 30 13:21:10.912794 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 482/971] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:10 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:11.672836 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:11.674530 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:11.697137 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.697962 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.699407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.700301 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.752567 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-2c9d890f-028a-47c5-8559-ca2c5f4565c7 req-dce000ce-9e5d-4404-9239-c76fb644f261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccecde33-e41a-46fc-9ee1-f0834326656f", "name": "network-vif-deleted", "tag": "f4d680b6-708a-42f8-a62f-e54604d1aaed"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:11.755668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:11.755668 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:21:11.771441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2c9d890f-028a-47c5-8559-ca2c5f4565c7 req-dce000ce-9e5d-4404-9239-c76fb644f261 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.772272 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-2c9d890f-028a-47c5-8559-ca2c5f4565c7 req-dce000ce-9e5d-4404-9239-c76fb644f261 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.793327 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-2c9d890f-028a-47c5-8559-ca2c5f4565c7 req-dce000ce-9e5d-4404-9239-c76fb644f261 service nova] Creating event network-vif-deleted:f4d680b6-708a-42f8-a62f-e54604d1aaed for instance ccecde33-e41a-46fc-9ee1-f0834326656f on hv-cinder-78445 Apr 30 13:21:11.799471 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-2c9d890f-028a-47c5-8559-ca2c5f4565c7 req-dce000ce-9e5d-4404-9239-c76fb644f261 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051894 Apr 30 13:21:11.800477 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 483/972] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:11.944520 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:11.945837 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:11.960704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.961538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.962978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.963774 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.016571 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:12.037560 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-dcac2639-104c-4726-a1c3-0fae4259b0b0 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.371695 Apr 30 13:21:12.038803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 490/973] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:11 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:12.080547 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:12.081068 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.081647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lazy-loading 'fault' on Instance uuid ccecde33-e41a-46fc-9ee1-f0834326656f {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:21:12.173353 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2b47c937514fe881a9512043d199e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea398af75bc44966965248e1ea7440c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:12.182645 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-04c799f5-3775-4491-86c6-d2dc6a66c286 tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 200 len: 1307 microversion: 2.1 time: 0.247593 Apr 30 13:21:12.183311 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 484/974] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:11 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:13.058111 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:13.059040 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:13.068834 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.069627 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.070567 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.071065 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.206267 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:13.207555 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] [instance: ccecde33-e41a-46fc-9ee1-f0834326656f] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:13.224592 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.225487 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.227014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.227842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.346341 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] HTTP exception thrown: Instance ccecde33-e41a-46fc-9ee1-f0834326656f could not be found. Apr 30 13:21:13.347045 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] Returning 404 to user: Instance ccecde33-e41a-46fc-9ee1-f0834326656f could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:13.348185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6ada8107-0777-4cc9-b076-a2e46e33210e tempest-AttachVolumeNegativeTest-1134566046 tempest-AttachVolumeNegativeTest-1134566046-project] 10.222.0.69 "GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f" status: 404 len: 111 microversion: 2.1 time: 0.150387 Apr 30 13:21:13.348914 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 485/975] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:13 2021] GET /compute/v2.1/servers/ccecde33-e41a-46fc-9ee1-f0834326656f => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:21:13.349872 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:13.359907 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1a517292-1ba6-49b0-9a31-caba509c3932 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.306873 Apr 30 13:21:13.360502 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 491/976] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:13 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:14.380081 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:14.381503 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:14.396247 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:14.397058 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:14.398598 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:14.399403 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:15.027138 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:15.044129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6c8d0baf-7f41-4f88-9923-aae8ac6780a6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.670305 Apr 30 13:21:15.045166 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 486/977] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:14 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:15.232220 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-bd773e5d-44cb-4501-ada2-dbaf82c82652 req-702b1242-39b0-4156-b8f4-c2d33514bd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86053f5e-dd6e-4517-ad56-198ac12b3ab1", "name": "network-vif-plugged", "status": "completed", "tag": "c4bbd718-6742-46d3-8446-2788220e82f8"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:15.235643 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:15.235643 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:21:15.246379 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-bd773e5d-44cb-4501-ada2-dbaf82c82652 req-702b1242-39b0-4156-b8f4-c2d33514bd29 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:15.246833 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-bd773e5d-44cb-4501-ada2-dbaf82c82652 req-702b1242-39b0-4156-b8f4-c2d33514bd29 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:15.266390 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-bd773e5d-44cb-4501-ada2-dbaf82c82652 req-702b1242-39b0-4156-b8f4-c2d33514bd29 service nova] Creating event network-vif-plugged:c4bbd718-6742-46d3-8446-2788220e82f8 for instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 on hv-cinder-78445 Apr 30 13:21:15.272216 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-bd773e5d-44cb-4501-ada2-dbaf82c82652 req-702b1242-39b0-4156-b8f4-c2d33514bd29 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043820 Apr 30 13:21:15.272912 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 492/978] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:16.070638 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:16.071470 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:16.080848 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:16.081417 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:16.082295 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:16.082810 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:16.424961 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:16.434876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b301cedc-5b98-4d58-a4a6-29d365e938c5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1265 microversion: 2.1 time: 0.368828 Apr 30 13:21:16.435737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 487/979] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:16 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:17.462151 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:17.463187 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:17.474069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.474887 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:17.476673 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.477308 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:17.781444 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:17.795802 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-78faf5b8-3d99-4fc5-8417-78b0e8e4b8bc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1453 microversion: 2.1 time: 0.339146 Apr 30 13:21:17.797194 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 493/980] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:17 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1453 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:17.829043 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:17.829043 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:17.833229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.833776 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:17.834679 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.835185 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:18.058167 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:18.073295 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f6863084-99a5-4fed-ab11-b8800d469904 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1453 microversion: 2.1 time: 0.254050 Apr 30 13:21:18.074286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 488/981] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:17 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1453 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:21.558548 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-9f93c7a9-c39b-41b8-b1f9-896d1b5746ac req-e66ea3de-b1b8-4c94-92f9-1b6bc4bc6d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86053f5e-dd6e-4517-ad56-198ac12b3ab1", "tag": "c4bbd718-6742-46d3-8446-2788220e82f8"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:21.560424 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:21.560424 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:21:21.569927 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-9f93c7a9-c39b-41b8-b1f9-896d1b5746ac req-e66ea3de-b1b8-4c94-92f9-1b6bc4bc6d7b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:21.570817 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-9f93c7a9-c39b-41b8-b1f9-896d1b5746ac req-e66ea3de-b1b8-4c94-92f9-1b6bc4bc6d7b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:21.590800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-9f93c7a9-c39b-41b8-b1f9-896d1b5746ac req-e66ea3de-b1b8-4c94-92f9-1b6bc4bc6d7b service nova] Creating event network-changed:c4bbd718-6742-46d3-8446-2788220e82f8 for instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 on hv-cinder-78445 Apr 30 13:21:21.598229 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-9f93c7a9-c39b-41b8-b1f9-896d1b5746ac req-e66ea3de-b1b8-4c94-92f9-1b6bc4bc6d7b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043005 Apr 30 13:21:21.599723 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 494/982] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:05.845402 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:22:05.846047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:22:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:22:39.553353 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1720182205", "imageRef": "30babcbf-ff4b-452d-bace-d5167743fc6c", "flavorRef": "452"}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:39.812806 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] validate_networks() for None {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:22:40.368236 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:22:40.368737 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:22:40.369222 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:22:40.369670 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:22:40.370080 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:22:40.380434 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:40.380882 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:40.381722 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:40.382162 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:40.400830 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Getting quotas for project 645d14ab3b74409aa0a6373e05a1e50b. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:22:40.405019 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Getting quotas for user b51dba6c7ec040ec8e0d87bae2448874 and project 645d14ab3b74409aa0a6373e05a1e50b. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:22:40.416876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:22:40.419316 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='30babcbf-ff4b-452d-bace-d5167743fc6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:22:40.489636 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b194b249-4005-4038-83b6-1dd67fd04200 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939785 Apr 30 13:22:40.490410 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 489/983] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:22:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:22:40.517918 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-907d3ee3-1743-4ced-9247-700b34b5dda7 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:40.518827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-907d3ee3-1743-4ced-9247-700b34b5dda7 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:40.676616 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-907d3ee3-1743-4ced-9247-700b34b5dda7 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:40.685386 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-907d3ee3-1743-4ced-9247-700b34b5dda7 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1215 microversion: 2.1 time: 0.184407 Apr 30 13:22:40.695193 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 495/984] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:40 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:41.704897 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:41.705978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:41.719154 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:41.720148 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:41.721617 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:41.722401 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:41.911303 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:41.921050 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-148ec6a5-7867-45b1-954b-68e369415d1d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1275 microversion: 2.1 time: 0.220436 Apr 30 13:22:41.921998 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 490/985] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:41 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:42.942059 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:42.943103 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:42.960030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:42.961286 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:42.963090 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:42.964162 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:43.479631 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:43.507438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f3979276-6331-4cc3-884e-8b0d06ab7265 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.572111 Apr 30 13:22:43.508522 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 496/986] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:42 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:44.394985 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-53045f2d-26ef-4be8-ba3e-2acb0e841886 req-867b5346-13c0-443b-8d26-b12abbb94bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd27d83a-f33c-4a27-96a4-4a2e619a65e1", "tag": "08b852bd-1af3-4d9d-a13d-4ad01f417428"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:44.398049 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:22:44.398049 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:22:44.413336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-53045f2d-26ef-4be8-ba3e-2acb0e841886 req-867b5346-13c0-443b-8d26-b12abbb94bb7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:44.414090 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-53045f2d-26ef-4be8-ba3e-2acb0e841886 req-867b5346-13c0-443b-8d26-b12abbb94bb7 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:44.440715 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-53045f2d-26ef-4be8-ba3e-2acb0e841886 req-867b5346-13c0-443b-8d26-b12abbb94bb7 service nova] Creating event network-changed:08b852bd-1af3-4d9d-a13d-4ad01f417428 for instance bd27d83a-f33c-4a27-96a4-4a2e619a65e1 on hv-cinder-78445 Apr 30 13:22:44.447827 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-53045f2d-26ef-4be8-ba3e-2acb0e841886 req-867b5346-13c0-443b-8d26-b12abbb94bb7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171197 Apr 30 13:22:44.448432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 491/987] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:44.536304 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:44.536945 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:44.545813 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:44.546263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:44.547281 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:44.547897 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:45.015192 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:45.024296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d36aeac7-fdf1-4e30-b9da-6fbe4fefe978 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.492274 Apr 30 13:22:45.024895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 497/988] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:44 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:46.054074 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:46.055456 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:46.069996 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:46.070786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:46.072193 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:46.072965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:46.377067 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:46.385825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c822d02f-efc2-468f-80fd-4233280d51ba tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.339221 Apr 30 13:22:46.386408 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 492/989] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:46 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:47.403223 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:47.403914 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:47.412204 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:47.412630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:47.413473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:47.413915 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:47.636419 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:47.645009 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6b99fb3d-50b3-4eaf-95ec-c1be800a48d6 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.245645 Apr 30 13:22:47.645908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 498/990] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:47 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:48.662011 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:48.662632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:48.671002 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:48.671460 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:48.672265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:48.672714 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:48.894704 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:48.904096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c018a236-7cab-4be7-bb41-a635fd43af68 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.245767 Apr 30 13:22:48.904692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 493/991] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:48 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:49.792851 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-92b1337e-67a8-4e9b-8053-8e3bc67bea16 req-a8f71738-e43a-4d13-9a8e-774038676164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd27d83a-f33c-4a27-96a4-4a2e619a65e1", "name": "network-vif-plugged", "status": "completed", "tag": "08b852bd-1af3-4d9d-a13d-4ad01f417428"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:49.795666 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:22:49.795666 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:22:49.806140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-92b1337e-67a8-4e9b-8053-8e3bc67bea16 req-a8f71738-e43a-4d13-9a8e-774038676164 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:49.806591 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-92b1337e-67a8-4e9b-8053-8e3bc67bea16 req-a8f71738-e43a-4d13-9a8e-774038676164 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:49.824238 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-92b1337e-67a8-4e9b-8053-8e3bc67bea16 req-a8f71738-e43a-4d13-9a8e-774038676164 service nova] Creating event network-vif-plugged:08b852bd-1af3-4d9d-a13d-4ad01f417428 for instance bd27d83a-f33c-4a27-96a4-4a2e619a65e1 on hv-cinder-78445 Apr 30 13:22:49.829637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-92b1337e-67a8-4e9b-8053-8e3bc67bea16 req-a8f71738-e43a-4d13-9a8e-774038676164 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130849 Apr 30 13:22:49.831608 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 499/992] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:22:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:49.923410 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:49.924309 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:49.934015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:49.934591 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:49.935636 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:49.936252 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:50.239739 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:50.248285 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a2a61010-8817-4a24-ac24-4e267ca1832d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1315 microversion: 2.1 time: 0.330316 Apr 30 13:22:50.248881 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 494/993] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:49 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:51.269524 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:51.270877 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:51.283207 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:51.283935 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:51.285365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:51.286142 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:51.687280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:51.696285 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b8653d5e-84ac-44ca-824a-45a9a2171799 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1465 microversion: 2.1 time: 0.433325 Apr 30 13:22:51.696867 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 500/994] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:51 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1465 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:51.781209 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:51.782113 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:51.796393 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:51.797211 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:51.798729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:51.799546 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:51.897853 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:22:52.027545 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-adccb381-057b-40a5-ada3-9f5863b37761 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "DELETE /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 204 len: 0 microversion: 2.1 time: 0.253567 Apr 30 13:22:52.028238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 495/995] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:22:51 2021] DELETE /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:22:52.037763 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:52.038446 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:52.046766 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:52.047215 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:52.048106 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:52.048544 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:52.259645 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:52.268776 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9fe9ec76-6cbc-4ce5-95e3-f4c36e4a0b6d tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1471 microversion: 2.1 time: 0.235426 Apr 30 13:22:52.269348 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 501/996] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:52 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:53.289609 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:53.290364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:53.298965 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:53.299415 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:53.300216 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:53.300789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:53.578191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:53.588514 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-b32462d5-4a30-496c-b829-715d15b63a2a tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1471 microversion: 2.1 time: 0.303054 Apr 30 13:22:53.589115 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 496/997] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:53 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:54.486389 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-12304174-d5e0-4e26-b951-0953cc30eace req-50567b23-0188-4944-88df-4c335554aa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd27d83a-f33c-4a27-96a4-4a2e619a65e1", "name": "network-vif-deleted", "tag": "08b852bd-1af3-4d9d-a13d-4ad01f417428"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:54.488661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:22:54.488661 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:22:54.501776 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-12304174-d5e0-4e26-b951-0953cc30eace req-50567b23-0188-4944-88df-4c335554aa40 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:54.503160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-12304174-d5e0-4e26-b951-0953cc30eace req-50567b23-0188-4944-88df-4c335554aa40 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:54.524206 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-12304174-d5e0-4e26-b951-0953cc30eace req-50567b23-0188-4944-88df-4c335554aa40 service nova] Creating event network-vif-deleted:08b852bd-1af3-4d9d-a13d-4ad01f417428 for instance bd27d83a-f33c-4a27-96a4-4a2e619a65e1 on hv-cinder-78445 Apr 30 13:22:54.538413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-12304174-d5e0-4e26-b951-0953cc30eace req-50567b23-0188-4944-88df-4c335554aa40 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055567 Apr 30 13:22:54.539459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 502/998] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:22:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:54.619364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:54.620521 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:54.634891 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:54.636077 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:54.637775 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:54.638355 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:54.755191 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:54.755636 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:54.756100 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.objects.instance [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lazy-loading 'fault' on Instance uuid bd27d83a-f33c-4a27-96a4-4a2e619a65e1 {{(pid=87983) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:22:54.834585 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51dba6c7ec040ec8e0d87bae2448874', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '645d14ab3b74409aa0a6373e05a1e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:54.844335 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-84447703-10b8-45f0-bea7-41c2fa71a01f tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 200 len: 1305 microversion: 2.1 time: 0.232374 Apr 30 13:22:54.844917 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 497/999] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:54 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:55.862981 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:55.863996 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] [instance: bd27d83a-f33c-4a27-96a4-4a2e619a65e1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:55.876899 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:55.877633 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:55.878760 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:55.879453 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:55.950832 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] HTTP exception thrown: Instance bd27d83a-f33c-4a27-96a4-4a2e619a65e1 could not be found. Apr 30 13:22:55.951434 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] Returning 404 to user: Instance bd27d83a-f33c-4a27-96a4-4a2e619a65e1 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:22:55.952283 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-6f1f027d-0c52-423e-940f-f2c97e91af02 tempest-VolumesNegativeTest-1432766754 tempest-VolumesNegativeTest-1432766754-project] 10.222.0.69 "GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1" status: 404 len: 111 microversion: 2.1 time: 0.093786 Apr 30 13:22:55.952827 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 503/1000] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:55 2021] GET /compute/v2.1/servers/bd27d83a-f33c-4a27-96a4-4a2e619a65e1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:23:20.710921 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:20.711573 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:20.719386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:20.719836 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:20.720749 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:20.721187 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:20.784171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:23:20.911063 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-7d34bb1e-9464-4955-81b9-119e1791a475 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "DELETE /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 204 len: 0 microversion: 2.1 time: 0.203591 Apr 30 13:23:20.911662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 498/1001] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:23:20 2021] DELETE /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:23:20.921030 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:20.921659 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:20.929012 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:20.929459 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:20.930263 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:20.930697 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:21.148947 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:21.162230 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-67d9d1e3-1d68-4ed7-916f-fd98d8a1ec79 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1577 microversion: 2.1 time: 0.245403 Apr 30 13:23:21.162944 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 504/1002] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:20 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:21.706315 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:23:21.706588 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:23:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:23:22.180846 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:22.181562 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:22.190643 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:22.191168 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:22.192251 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:22.192750 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:22.401127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:22.411952 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3a125da8-8b04-4dca-b744-71f31764a1a7 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1577 microversion: 2.1 time: 0.235476 Apr 30 13:23:22.412539 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 499/1003] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:22 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:23.429339 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:23.430052 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:23.438811 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:23.439359 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:23.440098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:23.440536 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:23.610448 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:23.621715 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ea021b52-ebd3-42a2-a473-c24f65d822be tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1509 microversion: 2.1 time: 0.195608 Apr 30 13:23:23.622413 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 505/1004] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:23 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:24.099953 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-b62ccad4-b069-4989-be0a-34693dd750f2 req-4d2f34e3-5707-4360-8c3e-c23c40496622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86053f5e-dd6e-4517-ad56-198ac12b3ab1", "name": "network-vif-deleted", "tag": "c4bbd718-6742-46d3-8446-2788220e82f8"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:23:24.102223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:23:24.102223 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:23:24.113021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-b62ccad4-b069-4989-be0a-34693dd750f2 req-4d2f34e3-5707-4360-8c3e-c23c40496622 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:24.113609 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-b62ccad4-b069-4989-be0a-34693dd750f2 req-4d2f34e3-5707-4360-8c3e-c23c40496622 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:24.133947 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-b62ccad4-b069-4989-be0a-34693dd750f2 req-4d2f34e3-5707-4360-8c3e-c23c40496622 service nova] Creating event network-vif-deleted:c4bbd718-6742-46d3-8446-2788220e82f8 for instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 on hv-cinder-78445 Apr 30 13:23:24.139674 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-b62ccad4-b069-4989-be0a-34693dd750f2 req-4d2f34e3-5707-4360-8c3e-c23c40496622 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Apr 30 13:23:24.140602 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 500/1005] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:24.642536 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:24.643157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:24.651176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:24.651628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:24.652462 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:24.652895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:24.739429 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:24.740060 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:24.740713 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.objects.instance [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lazy-loading 'fault' on Instance uuid 86053f5e-dd6e-4517-ad56-198ac12b3ab1 {{(pid=87984) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:23:24.829354 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:24.838687 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-1517fdcb-c19a-42bb-8ac2-3d78443c55b9 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 200 len: 1229 microversion: 2.1 time: 0.199934 Apr 30 13:23:24.839447 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 506/1006] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:24 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 1229 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:25.856995 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:25.857741 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:25.866245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:25.866699 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:25.867502 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:25.867944 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:25.920003 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] HTTP exception thrown: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. Apr 30 13:23:25.920635 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Returning 404 to user: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:23:25.921538 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-88b42659-5b44-44ce-ad84-f89f9c4510ec tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 404 len: 111 microversion: 2.1 time: 0.069088 Apr 30 13:23:25.922144 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 501/1007] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:25 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:23:26.033692 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-946928422", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631961270", "security_groups": [{"name": "tempest-secgroup-smoke-1987593170"}], "block_device_mapping_v2": [{"uuid": "ee06f04b-485b-43c7-9b1c-b0bf84ea2604", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b163249-98b0-4843-a8e2-23079bfd6bc7"}]}} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:23:26.208426 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.network.neutron [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] validate_networks() for [('2b163249-98b0-4843-a8e2-23079bfd6bc7', None, None, None)] {{(pid=87984) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:23:26.886958 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:23:26.887381 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image limits 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:23:26.887880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:23:26.888273 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image pref 0:0:0 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:23:26.888696 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.virt.hardware [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87984) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:23:26.898290 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:26.898777 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:26.899936 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:26.900474 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:26.923933 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:23:26.928721 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.quota [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for user 567cada28b6a4c2698bcf34bf61d427f and project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87984) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:23:27.046407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Going to run 1 instances... {{(pid=87984) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:23:27.049221 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ee06f04b-485b-43c7-9b1c-b0bf84ea2604',volume_size=None,volume_type=None)] {{(pid=87984) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:23:27.365102 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-60cedb36-d9e5-4dda-82eb-0fe20a7af583 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.335102 Apr 30 13:23:27.365921 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 507/1008] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:23:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:23:27.378034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4c4c50aa-eac8-425b-aa8d-7b1c75934bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:27.378767 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4c4c50aa-eac8-425b-aa8d-7b1c75934bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:27.454151 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4c4c50aa-eac8-425b-aa8d-7b1c75934bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:27.462401 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4c4c50aa-eac8-425b-aa8d-7b1c75934bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1093 microversion: 2.1 time: 0.089417 Apr 30 13:23:27.463275 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 502/1009] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:27 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:28.480864 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:28.482299 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:28.491366 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:28.492217 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:28.493468 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:28.494126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:28.744680 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:28.753227 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ad102963-e701-45ba-85db-8abcba036b7c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1199 microversion: 2.1 time: 0.276169 Apr 30 13:23:28.753854 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 508/1010] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:28 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:29.772129 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:29.773021 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:29.783097 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:29.783978 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:29.785198 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:29.785908 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:30.233650 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:30.242714 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a28ed315-663e-44c5-bb8b-037681d337c4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.475635 Apr 30 13:23:30.243372 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 503/1011] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:29 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:30.679116 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-a0dc8863-a4a9-41e4-bed4-60519cb859d8 req-92073117-3cb0-49df-8e21-8ccdff35c1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0", "tag": "69169ecd-78e9-49da-9059-af3f252d5b61"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:23:30.680866 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:23:30.680866 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:23:30.691782 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-a0dc8863-a4a9-41e4-bed4-60519cb859d8 req-92073117-3cb0-49df-8e21-8ccdff35c1fe service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:30.692800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-a0dc8863-a4a9-41e4-bed4-60519cb859d8 req-92073117-3cb0-49df-8e21-8ccdff35c1fe service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:30.717831 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-a0dc8863-a4a9-41e4-bed4-60519cb859d8 req-92073117-3cb0-49df-8e21-8ccdff35c1fe service nova] Creating event network-changed:69169ecd-78e9-49da-9059-af3f252d5b61 for instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 on hv-cinder-78445 Apr 30 13:23:30.724112 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-a0dc8863-a4a9-41e4-bed4-60519cb859d8 req-92073117-3cb0-49df-8e21-8ccdff35c1fe service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050213 Apr 30 13:23:30.724931 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 509/1012] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:23:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:31.260474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:31.261034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:31.269511 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:31.269964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:31.270756 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:31.271178 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:31.539789 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:31.550069 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bbe96b4f-a46e-4772-9a34-21b871fa553e tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.293478 Apr 30 13:23:31.550724 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 504/1013] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:31 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:32.569594 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:32.570473 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:32.580512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:32.581123 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:32.582146 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:32.582699 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:32.792312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:32.802574 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-60bdb795-4c2c-4743-b16b-d29ac1ee44b4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.238094 Apr 30 13:23:32.803192 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 510/1014] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:32 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:33.823473 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:33.824317 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:33.835394 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:33.835842 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:33.836614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:33.837064 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:34.044491 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:34.059364 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-19b42781-26be-4181-bca2-cf6ab5413aee tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.241962 Apr 30 13:23:34.060407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 505/1015] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:33 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:35.078277 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:35.078926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:35.086949 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:35.087404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:35.088195 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:35.088640 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:35.304197 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:35.316583 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-65c9642f-a5d4-4e3a-aba2-15be46aa737f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.241931 Apr 30 13:23:35.317533 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 511/1016] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:35 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:36.335596 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:36.336245 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:36.344991 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:36.346374 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:36.347340 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:36.348552 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:36.604944 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:36.614286 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-6f5c52d5-17dc-4f2d-a3c8-f147d29a0764 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.283814 Apr 30 13:23:36.614953 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 506/1017] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:36 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:37.632334 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:37.632908 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:37.641404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:37.641879 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:37.642655 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:37.643177 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:37.960181 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:37.969006 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-7797abbf-4cf1-455b-9d48-9cd3e5748f1b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.340461 Apr 30 13:23:37.969605 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 512/1018] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:37 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:38.987033 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:38.987712 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:38.995551 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:38.995997 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:38.996767 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:38.997197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:39.203010 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:39.212113 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-442e27ad-dc94-4190-a1d6-95196229a8a8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.228787 Apr 30 13:23:39.212659 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 507/1019] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:38 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:40.228845 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:40.229472 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:40.237144 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:40.237637 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:40.238438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:40.238885 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:40.447407 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:40.461589 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8cea6e9a-e7eb-4fd9-9c18-61e3862a4bb4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.236145 Apr 30 13:23:40.462838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 513/1020] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:40 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:41.478197 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:41.478783 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:41.486572 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:41.487025 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:41.487804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:41.488249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:41.689166 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:41.697825 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-2ae9ff06-6850-47be-a933-841a8486d22d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.223335 Apr 30 13:23:41.698977 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 508/1021] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:41 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:41.877275 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-4a82b00b-ba90-4a9b-b50d-51f1b4608b8d req-a323d048-eeb8-4307-a6a3-3c0b562a3e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0", "name": "network-vif-plugged", "status": "completed", "tag": "69169ecd-78e9-49da-9059-af3f252d5b61"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:23:41.879065 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:23:41.879065 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:23:41.888098 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-4a82b00b-ba90-4a9b-b50d-51f1b4608b8d req-a323d048-eeb8-4307-a6a3-3c0b562a3e6b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:41.888550 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-4a82b00b-ba90-4a9b-b50d-51f1b4608b8d req-a323d048-eeb8-4307-a6a3-3c0b562a3e6b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:41.908251 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-4a82b00b-ba90-4a9b-b50d-51f1b4608b8d req-a323d048-eeb8-4307-a6a3-3c0b562a3e6b service nova] Creating event network-vif-plugged:69169ecd-78e9-49da-9059-af3f252d5b61 for instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 on hv-cinder-78445 Apr 30 13:23:41.913964 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-4a82b00b-ba90-4a9b-b50d-51f1b4608b8d req-a323d048-eeb8-4307-a6a3-3c0b562a3e6b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040364 Apr 30 13:23:41.914592 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 514/1022] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:23:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:42.716652 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:42.717354 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:42.726004 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:42.726432 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:42.727692 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:42.728132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:42.932344 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:42.941681 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5c5f2b66-d2f1-4c15-a214-9bfe509b1bc6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1265 microversion: 2.1 time: 0.228966 Apr 30 13:23:42.942265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 509/1023] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:42 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:43.707450 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:23:43.707762 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:23:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:23:43.959110 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:43.959902 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:43.968312 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:43.968784 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:43.969607 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:43.970048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:44.183907 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:44.193757 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8a1bb531-0006-4a11-bead-1282277cd0a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1452 microversion: 2.1 time: 0.238708 Apr 30 13:23:44.194365 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 515/1024] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:43 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:44.210760 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:44.211334 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:23:44.219250 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:44.219706 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:44.220515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:44.220988 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:44.438034 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:23:44.446933 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9099097e-ac72-4208-865e-dfb22f6aa730 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1452 microversion: 2.1 time: 0.240039 Apr 30 13:23:44.447522 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 510/1025] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:23:44 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:23:47.784666 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-8e0b818c-8fab-4ace-9498-cbd6cd55ded8 req-222806e6-eed5-4157-a2f8-c038da7016e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0", "tag": "69169ecd-78e9-49da-9059-af3f252d5b61"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:23:47.786965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:23:47.786965 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:23:47.797993 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8e0b818c-8fab-4ace-9498-cbd6cd55ded8 req-222806e6-eed5-4157-a2f8-c038da7016e8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:23:47.798541 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8e0b818c-8fab-4ace-9498-cbd6cd55ded8 req-222806e6-eed5-4157-a2f8-c038da7016e8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:23:47.817140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-8e0b818c-8fab-4ace-9498-cbd6cd55ded8 req-222806e6-eed5-4157-a2f8-c038da7016e8 service nova] Creating event network-changed:69169ecd-78e9-49da-9059-af3f252d5b61 for instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 on hv-cinder-78445 Apr 30 13:23:47.822928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-8e0b818c-8fab-4ace-9498-cbd6cd55ded8 req-222806e6-eed5-4157-a2f8-c038da7016e8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301808 Apr 30 13:23:47.823753 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 516/1026] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:23:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:23.977489 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6815a720-f661-42e1-836f-53dcb090aad7] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:25:23.980920 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-278637550", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-631961270", "security_groups": [{"name": "tempest-secgroup-smoke-1987593170"}], "block_device_mapping_v2": [{"uuid": "daa93999-1f97-4e6a-9f6f-83841bbc54cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2b163249-98b0-4843-a8e2-23079bfd6bc7"}]}} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:25:24.153905 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.network.neutron [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] validate_networks() for [('2b163249-98b0-4843-a8e2-23079bfd6bc7', None, None, None)] {{(pid=87983) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:25:24.799729 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:25:24.800264 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image limits 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:25:24.801135 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Flavor pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:25:24.801786 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Image pref 0:0:0 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:25:24.802342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.virt.hardware [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87983) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:25:24.813586 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:24.814234 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:24.815399 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:24.816047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:24.835437 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:25:24.839885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.quota [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Getting quotas for user 567cada28b6a4c2698bcf34bf61d427f and project 84922ba9fd0e4a5baa2926c4a19eadbe. Resources: {'instances', 'ram', 'cores'} {{(pid=87983) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:25:24.955914 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Going to run 1 instances... {{(pid=87983) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:25:24.958109 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daa93999-1f97-4e6a-9f6f-83841bbc54cc',volume_size=None,volume_type=None)] {{(pid=87983) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:25:24.996866 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] [6815a720-f661-42e1-836f-53dcb090aad7] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 56990. Apr 30 13:25:25.144086 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [140816aa-58c5-4fd9-950b-83380b1ae059] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:25:26.163282 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [140816aa-58c5-4fd9-950b-83380b1ae059] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 56992. Apr 30 13:25:26.169229 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-dd77e6ca-2fd2-49cc-af09-13b43018b63f tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.193290 Apr 30 13:25:26.169917 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 511/1027] 10.222.0.69 () {60 vars in 1147 bytes} [Fri Apr 30 13:25:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:25:26.177895 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] AMQP server on 10.222.0.69:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:25:26.181768 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-078ff53d-0d9e-4190-89cc-13fdddcabf1a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:26.182546 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-078ff53d-0d9e-4190-89cc-13fdddcabf1a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:26.258848 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-078ff53d-0d9e-4190-89cc-13fdddcabf1a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:26.266362 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-078ff53d-0d9e-4190-89cc-13fdddcabf1a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1093 microversion: 2.1 time: 0.090075 Apr 30 13:25:26.266953 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 517/1028] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:26 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:27.286087 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:27.286817 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:27.296012 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:27.296465 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:27.297632 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:27.298065 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:27.427709 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:27.437254 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-9f2b93e6-3366-4eb2-b6a9-450b5101091c tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1191 microversion: 2.1 time: 0.157313 Apr 30 13:25:27.437863 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 512/1029] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:27 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:28.455156 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:28.456911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:28.483349 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:28.484165 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:28.485130 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:28.486126 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:28.486873 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0bd25e6-ca48-4969-842c-8900528ba427] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 57010. Apr 30 13:25:28.959061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:28.968625 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-9dbbd373-e6a2-4100-aa94-dd602e94294a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1277 microversion: 2.1 time: 0.517947 Apr 30 13:25:28.969099 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 518/1030] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:28 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1277 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:29.740096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-bdb17dec-5506-4786-a191-a8eff4720875 req-854c98fd-90a6-463c-b188-b35727e7b6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8072fc-98e1-43f7-8ab6-7d6625581846", "tag": "b33dc539-f714-44c3-bb2a-68c70aac219a"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:25:29.741808 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:25:29.741808 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:25:29.752649 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bdb17dec-5506-4786-a191-a8eff4720875 req-854c98fd-90a6-463c-b188-b35727e7b6a4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:29.753055 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-bdb17dec-5506-4786-a191-a8eff4720875 req-854c98fd-90a6-463c-b188-b35727e7b6a4 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:29.774638 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-bdb17dec-5506-4786-a191-a8eff4720875 req-854c98fd-90a6-463c-b188-b35727e7b6a4 service nova] Creating event network-changed:b33dc539-f714-44c3-bb2a-68c70aac219a for instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 on hv-cinder-78445 Apr 30 13:25:29.779894 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-bdb17dec-5506-4786-a191-a8eff4720875 req-854c98fd-90a6-463c-b188-b35727e7b6a4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044128 Apr 30 13:25:29.780676 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 513/1031] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:29.985441 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:29.986140 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:29.994042 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:29.994406 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:29.995189 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:29.995630 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:30.296272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:30.306320 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-b7a52fc3-b6ec-4305-9ee9-e432391d4003 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.324623 Apr 30 13:25:30.306932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 519/1032] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:29 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:31.324531 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:31.325162 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:31.332968 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:31.333405 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:31.334220 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:31.334640 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:31.540486 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:31.549515 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-3c657970-4f5a-41de-8285-af00b5492acc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.229316 Apr 30 13:25:31.550060 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 514/1033] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:31 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:32.566196 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:32.566874 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:32.578247 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:32.578933 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:32.580068 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:32.580743 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:32.788069 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:32.801911 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-c406e7ae-eb83-48b7-b002-43ec75482759 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.239004 Apr 30 13:25:32.802786 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 520/1034] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:32 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:33.823682 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:33.824238 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:33.832314 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:33.832769 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:33.833571 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:33.834047 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:34.150330 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:34.159199 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0ed05e06-c536-4beb-b2ba-7f265dd87d86 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.341077 Apr 30 13:25:34.159759 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 515/1035] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:33 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:35.255084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:35.255695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:35.263157 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:35.263590 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:35.264388 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:35.264789 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:35.466986 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:35.475486 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-08dbb7d5-4f3e-4cf4-841e-f04c7a002ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.302387 Apr 30 13:25:35.476086 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 521/1036] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:35 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:36.492371 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:36.492934 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:36.501788 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:36.502717 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:36.503865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:36.504306 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:36.725496 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:36.734526 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c5c8af26-4c80-43d8-a868-cd3c607073f8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.246014 Apr 30 13:25:36.735117 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 516/1037] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:36 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:37.751246 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:37.751855 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:37.762628 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:37.763037 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:37.763830 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:37.764272 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:37.983296 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:37.992026 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-f99c104f-7887-4ed6-b138-962d6d48a9f2 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.244728 Apr 30 13:25:37.992584 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 522/1038] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:37 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:39.011099 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:39.012198 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:39.026734 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:39.027461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:39.028336 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:39.028823 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:39.233342 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:39.247658 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a12b07e6-6f48-4586-87ae-676133ee4592 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.242925 Apr 30 13:25:39.248559 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 517/1039] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:39 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:40.263932 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:40.264720 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:40.272367 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:40.272928 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:40.273748 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:40.274178 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:40.422790 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [req-7a2baf16-a6ad-4fdb-bca5-07e275fd12f5 req-42fb9716-f706-413e-a7d5-f5228cb9125b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8072fc-98e1-43f7-8ab6-7d6625581846", "name": "network-vif-plugged", "status": "completed", "tag": "b33dc539-f714-44c3-bb2a-68c70aac219a"}]} {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:25:40.424862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:25:40.424862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: warnings.warn(msg) Apr 30 13:25:40.437205 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7a2baf16-a6ad-4fdb-bca5-07e275fd12f5 req-42fb9716-f706-413e-a7d5-f5228cb9125b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:40.437422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [req-7a2baf16-a6ad-4fdb-bca5-07e275fd12f5 req-42fb9716-f706-413e-a7d5-f5228cb9125b service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:40.459036 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.compute.server_external_events [req-7a2baf16-a6ad-4fdb-bca5-07e275fd12f5 req-42fb9716-f706-413e-a7d5-f5228cb9125b service nova] Creating event network-vif-plugged:b33dc539-f714-44c3-bb2a-68c70aac219a for instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 on hv-cinder-78445 Apr 30 13:25:40.466145 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [req-7a2baf16-a6ad-4fdb-bca5-07e275fd12f5 req-42fb9716-f706-413e-a7d5-f5228cb9125b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047974 Apr 30 13:25:40.467114 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 518/1040] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:25:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:40.485695 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:40.494645 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a2823cec-07e7-4bf2-9b85-5bf975d3ae0a tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.234293 Apr 30 13:25:40.504004 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 523/1041] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:40 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:41.512662 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:41.513445 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:41.521307 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:41.521802 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:41.522589 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:41.523024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:41.844407 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:41.853029 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-5c34d627-c260-433c-9552-9d43de2e7825 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1265 microversion: 2.1 time: 0.344436 Apr 30 13:25:41.853361 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 519/1042] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:41 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1265 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:42.869781 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:42.870405 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:42.878345 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:42.878793 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:42.879596 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:42.880035 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:43.093095 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:43.101602 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-8d5cfb0f-0739-4529-ade0-63527d50874d tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1453 microversion: 2.1 time: 0.235588 Apr 30 13:25:43.102199 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 524/1043] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:42 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1453 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:43.117892 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:43.118461 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:43.126811 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:43.127259 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:43.128043 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:43.128474 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:43.447976 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:43.457038 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-d5079c1f-249c-4d00-9302-4822fcd603a3 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1453 microversion: 2.1 time: 0.342990 Apr 30 13:25:43.457742 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 520/1044] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:43 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1453 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:46.026188 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-2ee12b10-8f78-4eb8-9495-a27c0edab3e0 req-88f2c2ff-06c7-4367-8447-0d721e0c04b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8072fc-98e1-43f7-8ab6-7d6625581846", "tag": "b33dc539-f714-44c3-bb2a-68c70aac219a"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:25:46.028167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:25:46.028167 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:25:46.037991 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-2ee12b10-8f78-4eb8-9495-a27c0edab3e0 req-88f2c2ff-06c7-4367-8447-0d721e0c04b8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:46.038452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-2ee12b10-8f78-4eb8-9495-a27c0edab3e0 req-88f2c2ff-06c7-4367-8447-0d721e0c04b8 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:46.056926 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-2ee12b10-8f78-4eb8-9495-a27c0edab3e0 req-88f2c2ff-06c7-4367-8447-0d721e0c04b8 service nova] Creating event network-changed:b33dc539-f714-44c3-bb2a-68c70aac219a for instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 on hv-cinder-78445 Apr 30 13:25:46.063209 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-2ee12b10-8f78-4eb8-9495-a27c0edab3e0 req-88f2c2ff-06c7-4367-8447-0d721e0c04b8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053646 Apr 30 13:25:46.063841 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 525/1045] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:25:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:31.820403 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:26:31.821677 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:26:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:26:41.726404 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:26:41.727076 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:26:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:03.730149 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:27:03.731053 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:27:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:15.708828 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:15.711505 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:15.712512 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-8901d93e-060e-4200-bbcd-d846f70a4dbf req-9a5f9309-13f0-4348-bdf6-41c24b108e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8072fc-98e1-43f7-8ab6-7d6625581846", "tag": "b33dc539-f714-44c3-bb2a-68c70aac219a"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:27:15.714452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:27:15.714452 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:27:15.722940 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:15.723819 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:15.725422 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:15.726265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:15.727332 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8901d93e-060e-4200-bbcd-d846f70a4dbf req-9a5f9309-13f0-4348-bdf6-41c24b108e3f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:15.727856 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-8901d93e-060e-4200-bbcd-d846f70a4dbf req-9a5f9309-13f0-4348-bdf6-41c24b108e3f service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:15.750084 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-8901d93e-060e-4200-bbcd-d846f70a4dbf req-9a5f9309-13f0-4348-bdf6-41c24b108e3f service nova] Creating event network-changed:b33dc539-f714-44c3-bb2a-68c70aac219a for instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 on hv-cinder-78445 Apr 30 13:27:15.757425 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-8901d93e-060e-4200-bbcd-d846f70a4dbf req-9a5f9309-13f0-4348-bdf6-41c24b108e3f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049709 Apr 30 13:27:15.758500 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 526/1046] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:27:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:15.820590 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:27:16.040246 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c24320b5-4a74-4f2d-8e1b-df67b6361b71 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 204 len: 0 microversion: 2.1 time: 0.336310 Apr 30 13:27:16.042014 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 521/1047] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:27:15 2021] DELETE /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:27:16.052837 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:16.054197 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:16.068438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:16.069160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:16.070532 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:16.071236 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:16.708265 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:16.719048 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-d459d89a-f715-4cd6-a2c2-29a5368c33a5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1577 microversion: 2.1 time: 0.671551 Apr 30 13:27:16.733617 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 527/1048] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:16 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1577 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:17.743419 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:17.744020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:17.758353 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:17.758875 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:17.759862 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:17.760386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:18.184814 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:18.201280 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-f9cf6894-1d16-409d-8991-5eb4dd83d238 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1459 microversion: 2.1 time: 0.462285 Apr 30 13:27:18.202386 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 522/1049] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:17 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1459 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:18.731176 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-bf54bd71-6133-4537-b89b-d9a4bd603be8 req-dda36208-4c14-4663-8ba0-44bff289667a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8072fc-98e1-43f7-8ab6-7d6625581846", "name": "network-vif-deleted", "tag": "b33dc539-f714-44c3-bb2a-68c70aac219a"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:27:18.732865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:27:18.732865 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:27:18.742872 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-bf54bd71-6133-4537-b89b-d9a4bd603be8 req-dda36208-4c14-4663-8ba0-44bff289667a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:18.743410 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-bf54bd71-6133-4537-b89b-d9a4bd603be8 req-dda36208-4c14-4663-8ba0-44bff289667a service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:18.763255 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-bf54bd71-6133-4537-b89b-d9a4bd603be8 req-dda36208-4c14-4663-8ba0-44bff289667a service nova] Creating event network-vif-deleted:b33dc539-f714-44c3-bb2a-68c70aac219a for instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 on hv-cinder-78445 Apr 30 13:27:18.769338 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-bf54bd71-6133-4537-b89b-d9a4bd603be8 req-dda36208-4c14-4663-8ba0-44bff289667a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042095 Apr 30 13:27:18.770254 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 528/1050] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:27:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:27:19.220496 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:19.221019 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:19.230412 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:19.230870 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:19.231696 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:19.232136 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:19.388092 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:19.399020 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-bd576b8b-ddac-4f6d-904d-c9d123a96f7b tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 200 len: 1224 microversion: 2.1 time: 0.182345 Apr 30 13:27:19.399608 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 523/1051] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:19 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:20.424438 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:20.425278 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 3c8072fc-98e1-43f7-8ab6-7d6625581846] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:20.434270 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:20.434725 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:20.435552 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:20.435992 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:20.490182 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] HTTP exception thrown: Instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 could not be found. Apr 30 13:27:20.490803 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Returning 404 to user: Instance 3c8072fc-98e1-43f7-8ab6-7d6625581846 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:27:20.491645 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-4074bf2b-a4a4-4eeb-81cb-5921d43e2471 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846" status: 404 len: 111 microversion: 2.1 time: 0.071593 Apr 30 13:27:20.492241 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 529/1052] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:20 2021] GET /compute/v2.1/servers/3c8072fc-98e1-43f7-8ab6-7d6625581846 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:27:24.670127 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:24.671350 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:24.672385 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-a9210c88-9abf-4612-97b2-cf61749f21a6 req-d5428e46-58d4-4b14-bddf-f6f5d2bb4ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0", "tag": "69169ecd-78e9-49da-9059-af3f252d5b61"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:27:24.673910 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:27:24.673910 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:27:24.680186 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.680647 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.681441 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.682111 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.685647 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-a9210c88-9abf-4612-97b2-cf61749f21a6 req-d5428e46-58d4-4b14-bddf-f6f5d2bb4ea9 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.686111 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-a9210c88-9abf-4612-97b2-cf61749f21a6 req-d5428e46-58d4-4b14-bddf-f6f5d2bb4ea9 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.704545 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-a9210c88-9abf-4612-97b2-cf61749f21a6 req-d5428e46-58d4-4b14-bddf-f6f5d2bb4ea9 service nova] Creating event network-changed:69169ecd-78e9-49da-9059-af3f252d5b61 for instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 on hv-cinder-78445 Apr 30 13:27:24.710483 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-a9210c88-9abf-4612-97b2-cf61749f21a6 req-d5428e46-58d4-4b14-bddf-f6f5d2bb4ea9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041737 Apr 30 13:27:24.711333 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 530/1053] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:27:24.748805 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Going to try to terminate instance {{(pid=87983) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:27:24.889868 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-0e16f4ac-4245-4abe-896a-0f74372debd4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 204 len: 0 microversion: 2.1 time: 0.222540 Apr 30 13:27:24.890959 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 524/1054] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:27:24 2021] DELETE /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:27:24.902108 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:24.904398 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:24.916498 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.916880 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.918051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.918477 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:25.383519 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.policy [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87984) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:25.392226 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-a32bd917-f411-461d-a335-a9edfb325867 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1577 microversion: 2.1 time: 0.495105 Apr 30 13:27:25.392810 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 531/1055] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:24 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1577 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:26.411580 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:26.412249 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:26.420667 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:26.421126 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:26.421964 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:26.422409 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:26.673807 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:26.683024 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-a50fd37f-84f1-4137-b4bd-e3c0e2011646 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1458 microversion: 2.1 time: 0.275681 Apr 30 13:27:26.683665 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 525/1056] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:26 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1458 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:27.560051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [req-7c1ae5d9-d126-4cad-8cf7-3c3eedddf063 req-e2c52927-c6d6-41b2-9e78-70a1b5f78164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0", "name": "network-vif-deleted", "tag": "69169ecd-78e9-49da-9059-af3f252d5b61"}]} {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:27:27.563581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:27:27.563581 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: warnings.warn(msg) Apr 30 13:27:27.586678 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-7c1ae5d9-d126-4cad-8cf7-3c3eedddf063 req-e2c52927-c6d6-41b2-9e78-70a1b5f78164 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:27.587326 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [req-7c1ae5d9-d126-4cad-8cf7-3c3eedddf063 req-e2c52927-c6d6-41b2-9e78-70a1b5f78164 service nova] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:27.605660 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.compute.server_external_events [req-7c1ae5d9-d126-4cad-8cf7-3c3eedddf063 req-e2c52927-c6d6-41b2-9e78-70a1b5f78164 service nova] Creating event network-vif-deleted:69169ecd-78e9-49da-9059-af3f252d5b61 for instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 on hv-cinder-78445 Apr 30 13:27:27.613686 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [req-7c1ae5d9-d126-4cad-8cf7-3c3eedddf063 req-e2c52927-c6d6-41b2-9e78-70a1b5f78164 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058234 Apr 30 13:27:27.614161 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 532/1057] 10.222.0.69 () {64 vars in 1318 bytes} [Fri Apr 30 13:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:27.702553 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:27.703171 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:27.710885 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:27.711338 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:27.712132 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:27.712553 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:27.864331 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.policy [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567cada28b6a4c2698bcf34bf61d427f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84922ba9fd0e4a5baa2926c4a19eadbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87983) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:27.874847 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-4ed58487-9cda-41e2-b2f7-44a997d99fd6 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 200 len: 1224 microversion: 2.1 time: 0.176205 Apr 30 13:27:27.875513 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 526/1058] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:27 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:28.893838 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:28.894576 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:28.903051 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:28.903549 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:28.904411 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:28.905081 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:28.985787 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] HTTP exception thrown: Instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 could not be found. Apr 30 13:27:28.986431 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Returning 404 to user: Instance e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:27:28.987475 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-ce14e943-5629-4cc0-8531-748a03eb67a4 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0" status: 404 len: 111 microversion: 2.1 time: 0.098188 Apr 30 13:27:28.988091 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 533/1059] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:28 2021] GET /compute/v2.1/servers/e49bf54e-fdf0-4b1a-91f8-e36e37ac3cd0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:27:29.997096 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:29.998070 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.compute.api [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87983) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:30.006157 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.006614 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.007420 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.007865 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG oslo_concurrency.lockutils [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.059106 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.wsgi [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] HTTP exception thrown: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. Apr 30 13:27:30.059851 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Returning 404 to user: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. {{(pid=87983) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:27:30.060804 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-c3da79fc-a0f0-4be9-9a01-08aa80fcbcbc tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "DELETE /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 404 len: 111 microversion: 2.1 time: 0.068112 Apr 30 13:27:30.061512 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 527/1060] 10.222.0.69 () {58 vars in 1239 bytes} [Fri Apr 30 13:27:29 2021] DELETE /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:27:30.070800 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '>' {{(pid=87984) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:30.071412 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.compute.api [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] [instance: 86053f5e-dd6e-4517-ad56-198ac12b3ab1] Fetching instance by UUID {{(pid=87984) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:30.079280 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.079702 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.080499 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.080942 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG oslo_concurrency.lockutils [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Lock "444fc578-91ce-49dd-ac6d-4dd08107152f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.133061 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.wsgi [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] HTTP exception thrown: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. Apr 30 13:27:30.134682 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: DEBUG nova.api.openstack.wsgi [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Returning 404 to user: Instance 86053f5e-dd6e-4517-ad56-198ac12b3ab1 could not be found. {{(pid=87984) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:27:30.134892 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO nova.api.openstack.requestlog [None req-428f3544-8fca-421c-92c3-3cfdb1b505e8 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1" status: 404 len: 111 microversion: 2.1 time: 0.068277 Apr 30 13:27:30.135396 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: [pid: 87984|app: 0|req: 534/1061] 10.222.0.69 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:30 2021] GET /compute/v2.1/servers/86053f5e-dd6e-4517-ad56-198ac12b3ab1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:27:31.718876 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: DEBUG nova.api.openstack.wsgi [None req-17f88510-2af8-44be-b071-29dcd4d11ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] Calling method '.version_select at 0x7fe2fb3a7430>' {{(pid=87983) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:31.745265 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO nova.api.openstack.requestlog [None req-17f88510-2af8-44be-b071-29dcd4d11ee5 tempest-TestVolumeBootPattern-659759687 tempest-TestVolumeBootPattern-659759687-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-631961270" status: 202 len: 0 microversion: 2.1 time: 0.031876 Apr 30 13:27:31.745886 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: [pid: 87983|app: 0|req: 528/1062] 10.222.0.69 () {58 vars in 1260 bytes} [Fri Apr 30 13:27:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-631961270 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:29:51.841828 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:29:51.842712 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:29:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:01.746641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:01.746641 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:30:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:17.143440 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:17.144160 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:30:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:23.752240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:23.752240 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:30:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:26.176459 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:26.177204 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:30:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:27.404301 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:27.405015 dv-cinder-784453-4-iscsi devstack@n-api.service[87983]: Fri Apr 30 13:30:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:33:11.862427 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:33:11.863071 dv-cinder-784453-4-iscsi devstack@n-api.service[87984]: Fri Apr 30 13:33:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!